-- Logs begin at Mon 2022-05-16 13:26:28 UTC, end at Mon 2022-05-16 14:13:49 UTC. -- May 16 13:57:35.706458 dv-cinder-795785-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 13:57:35.715625 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 13:57:35.718433 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 13:57:35 2022] *** May 16 13:57:35.718628 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 13:57:35.718801 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 13:57:35.718959 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: nodename: dv-cinder-795785-9-iscsi May 16 13:57:35.719114 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: machine: x86_64 May 16 13:57:35.719278 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: clock source: unix May 16 13:57:35.719430 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: pcre jit disabled May 16 13:57:35.719582 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: detected number of CPU cores: 4 May 16 13:57:35.719734 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: current working directory: / May 16 13:57:35.719891 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: detected binary path: /usr/bin/uwsgi-core May 16 13:57:35.720049 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: your processes number limit is 47680 May 16 13:57:35.720158 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: your memory page size is 4096 bytes May 16 13:57:35.720267 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: detected max file descriptor number: 2048 May 16 13:57:35.720267 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: lock engine: pthread robust mutexes May 16 13:57:35.720478 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: thunder lock: enabled May 16 13:57:35.720642 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 13:57:35.720837 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 13:57:35.766644 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: Python main interpreter initialized at 0x560ae66869c0 May 16 13:57:35.766644 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: python threads support enabled May 16 13:57:35.766644 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: your server socket listen backlog is limited to 100 connections May 16 13:57:35.766644 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: your mercy for graceful operations on workers is 90 seconds May 16 13:57:35.767035 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: mapped 403077 bytes (393 KB) for 2 cores May 16 13:57:35.767111 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: *** Operational MODE: preforking *** May 16 13:57:35.767356 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: *** uWSGI is running in multiple interpreter mode *** May 16 13:57:35.767356 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: spawned uWSGI master process (pid: 80043) May 16 13:57:35.767562 dv-cinder-795785-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 13:57:35.768910 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: spawned uWSGI worker 1 (pid: 80057, cores: 1) May 16 13:57:35.770005 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: spawned uWSGI worker 2 (pid: 80058, cores: 1) May 16 13:57:35.770005 dv-cinder-795785-9-iscsi devstack@keystone.service[80043]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 13:57:41.608427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 13:57:41.608427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: from cryptography.utils import int_from_bytes May 16 13:57:41.609342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 13:57:41.609342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: from cryptography.utils import int_from_bytes May 16 13:57:41.609771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 13:57:41.609771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: from cryptography.utils import int_from_bytes May 16 13:57:41.610132 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 13:57:41.610132 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: from cryptography.utils import int_from_bytes May 16 13:57:41.659518 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 13:57:41.659690 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 13:57:41.659901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] command line args: [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 13:57:41.660071 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 13:57:41.660155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 13:57:41.660229 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 13:57:41.660295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ================================================================================ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 13:57:41.660452 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] command line args: [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 13:57:41.660532 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] admin_token = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.660704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 13:57:41.660800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] config_dir = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.660874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ================================================================================ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 13:57:41.660940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.661111 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] config_source = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.661191 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] admin_token = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.661394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] debug = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.661548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] config_dir = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.663172 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] config_source = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664434 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664501 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] debug = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664636 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664636 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.664994 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_config_append = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665171 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665239 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_dir = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_config_append = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665611 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665675 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_dir = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665675 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665783 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665840 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665896 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.665959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666373 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666509 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666755 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666811 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666929 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.666994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667109 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667295 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] publish_errors = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.667687 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.668464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] publish_errors = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.668713 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.668885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.669123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.669327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.669526 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.669695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.669981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.670214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.670415 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] standard_threads = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.670618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.670834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.671043 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] standard_threads = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.671210 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.671439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.671641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.671641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_journal = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.671992 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.672225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_json = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.672392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.672586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_stderr = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.672786 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_journal = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.673135 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] use_syslog = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.673324 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_json = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.673324 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_stderr = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.673704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.673836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] use_syslog = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.673999 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.674133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 13:57:41.674270 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.674413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.674545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.674715 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.674881 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.675012 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.675150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.675283 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.675413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.675552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.675682 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.675812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.676019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.676159 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.676291 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.676426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.676556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.676716 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.676864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.677046 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.677207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.677408 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.677616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.677859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.678029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.678163 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.678311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.678452 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.678589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.678722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.678863 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.678995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.679126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.679255 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.679396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.679527 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.679677 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.679810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.679946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.680077 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.680206 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.680341 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.680485 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.680617 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.680848 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.680980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.681110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.681240 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.681382 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.681524 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.681655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.681785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.681914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.681914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.682166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.682296 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.682425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.682561 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.682698 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.682829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.683035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.683168 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.683298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.683444 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.683583 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.683714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.683853 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.683991 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.684122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.684257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.684388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.684571 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.684747 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.684886 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.685016 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.685145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.685285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.685423 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.685555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.685691 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.685828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.685959 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.686089 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.686226 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.686358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.686494 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.686625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.686761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.686898 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.687040 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.688499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.688774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.688970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.689164 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.689517 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.689730 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.689898 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.690093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.690286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.690479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.690706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.690914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.691082 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.691355 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.691563 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.691731 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.691927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.692167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.692334 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.693096 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.693268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.693586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.693933 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.694230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.694405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.694542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.694713 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.694858 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.695022 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.695167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.695308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.695442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.695582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.695754 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.695899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.696032 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.696173 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.696307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.696451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.696584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.696752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.696893 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.697060 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.697204 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.697339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.697470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.697606 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.697739 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.697869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.698009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.698141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.698272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.698272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.698528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.698660 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.698799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.698941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.699074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.699204 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.699381 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.699515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.699692 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.699859 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.699995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.700126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.700257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.700389 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.700606 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.700799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.700933 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.701065 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.701195 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.701337 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.701472 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.701603 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.701734 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.701865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.701995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.702134 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.702266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.702403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.702403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.702663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.702801 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.702942 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.703074 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.703205 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.703335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.703472 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.703605 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.703749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.703893 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.704034 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.704165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.704306 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.704443 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.704576 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.704724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.704872 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.705013 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.705171 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.705388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.705555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.705692 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.705833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.705967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.706099 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.706230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.706372 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.706504 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.706646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.706780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.706913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.707044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.external = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.707175 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.707306 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.707446 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.707579 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.707714 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.707852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.707991 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.708132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.password = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.708877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.external = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.709112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.token = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.709339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.709558 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.709746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.709907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.710046 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.710188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.710322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.password = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.710454 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.710586 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.token = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.710719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.710853 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.711005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.711005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.711263 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.711397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.711529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.711661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.711801 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.711936 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.712068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.712202 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.712334 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.712466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.712612 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.712798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.712944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.713077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.713209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.713340 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.713484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.713619 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.713751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.713883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.714017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.714157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.714299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.714299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.714564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.714708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.714841 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.714973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.715115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.715249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.715381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.715518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.715921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.715921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.716187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.716329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.716461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.716592 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.716768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.716916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.717062 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.717197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.717329 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.717467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.717602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.717746 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.717964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.718108 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.718243 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.718375 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.718513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.718647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.718799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.718940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.719073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.719206 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.719351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.719483 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.719624 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.719763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.719905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.720037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.720169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.720302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.720443 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.720577 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.720780 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.720919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.721052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.721437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.721581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.721715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.721848 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.721980 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.722112 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.722243 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.722385 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.722518 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.722651 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.722792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.722792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.723050 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.723190 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.723323 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.723456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.723587 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.723719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.723897 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.724034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.724167 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.724376 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.724585 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.724585 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.725084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.725228 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.725362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.725494 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.725627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.725760 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.725900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.726033 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.726165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.726165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.726413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.726545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.726685 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.726828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.726961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.727091 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.727222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.727353 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.727493 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.727626 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.727758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.727889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.728020 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.728150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.728290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.728423 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.728555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.728778 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.728918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.729051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.729194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.729329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.729461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.729593 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.729726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.729868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.730010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.730143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.730275 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.730406 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.730537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.730678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.730820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.730953 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.731086 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.731217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.731348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.731480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.731619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.731753 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.731886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.732018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.732150 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.732281 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.732435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.732569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.732718 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.732855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.732989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.733121 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.733264 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.733405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.733540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.733671 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.733803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.733942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.734084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.734217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.734367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.734500 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.734632 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.734763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.734763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.735022 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.735154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.735286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.735417 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.735548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.735687 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.735820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.735951 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.736083 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.736224 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.736358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.736499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.736632 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.736786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.736919 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.737051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.737194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.737328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.737460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.737592 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.737723 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.737854 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.738003 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.738137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.738268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.738400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.738539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.738671 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.738811 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.738943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.739075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.739206 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.739338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.739504 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.739648 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.739824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.739824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.740245 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.740468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.740652 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.740825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.740961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.741094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.741226 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.741359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.741491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.741634 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.741768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.741900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.742032 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.742174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.742307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.742448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.742581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.742713 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.742844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.742975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.743112 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.743263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.743399 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.743530 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.743661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.743792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.743933 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.744074 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.744207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.744339 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.744471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.744602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.744776 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.744992 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.745128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.745260 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.745392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.745525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.745657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.745797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.745942 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.746074 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.746206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.746337 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.746469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.746609 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.746742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.746874 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] role.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.747073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.747210 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] role.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.747342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.747482 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.747617 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.747749 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.747891 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.748023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.748156 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.748296 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.748429 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.748561 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.748722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.748861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.748993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.749136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.749270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] role.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.749401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.749533 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] role.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.749675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.749813 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.749958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.750091 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.750223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.750354 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.750487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.750619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.750760 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.750894 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.751026 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.751158 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.751290 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.751440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.751580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.751719 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.751854 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.751988 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.752120 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.752261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.752394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.752526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.752664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.752869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.753009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.753160 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.753301 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.753451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.753591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.753591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.753855 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.754002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.754142 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.754281 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.754420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.754559 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.754704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.754904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.755892 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.756133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.756381 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.756607 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.756778 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.756938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.757081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.757219 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.757358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.757500 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.757639 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.757787 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.757935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.758077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.758217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.758368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.758507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.758654 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.758795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.758934 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.759075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.759213 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.759359 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.759500 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.759645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.759785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.759925 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.760063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.760213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.760363 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.760503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.760648 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.760899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.761040 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.761192 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.761334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.761473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.761620 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.761760 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.761900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.761900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.762172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.762312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.762463 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.762463 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.762726 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.762873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.763012 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.763159 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.763308 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.763448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.763587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.763587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.763849 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.763995 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.764135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.764283 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.764424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.764562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.764562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.764937 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.765080 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.765219 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.765358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.765497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.765635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.765635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.765908 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.766048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.766186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.766344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.766495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.766635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.766781 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.766922 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.767060 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.767199 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.767339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.767479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.767626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.767767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.767767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.768040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.769307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.769307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.769307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.769307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 13:57:41.769307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 13:57:41.775963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.776304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.776455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.781537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.781760 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.781984 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.785537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.791196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.814688 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.815100 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.818995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.819351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.872687 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.872988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.925441 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.925776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.926337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.926589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.994396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.994720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.994812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.995027 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.995177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.995262 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.995427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.995509 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.995692 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.995836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.996052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:41.996269 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.019722 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.019923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.020002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.020068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.020132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.020492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.020583 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.020830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.020912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.021013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.021127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.021237 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.021372 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.021493 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.033256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.034424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.046635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.046946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.047106 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.047322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.047487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.047827 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.047971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.048329 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.048567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.048820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.049047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.049269 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.049484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.049699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 13:57:42.065641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.065915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 13:57:42.066173 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.066285 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.066352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 13:57:42.066413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 13:57:42.066671 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.066756 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.066924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.067016 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 13:57:42.067182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.067265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.067484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.067571 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.068268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.068529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.078848 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.079121 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.079383 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.079575 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.079682 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.079857 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.080118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.080397 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.087829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.088790 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.091274 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.091547 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.091824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.092098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.092203 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.092400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.092607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.092863 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.093071 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.093261 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.093418 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.093600 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.093746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.093885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.094024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.094173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.094313 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.094451 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.094589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.094589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.094861 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.094861 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.121794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.122977 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.123430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.123703 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.125814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.125814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.129032 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.129301 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.129563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.130917 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.131252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.131597 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.137617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.137890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.139049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.139336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.142337 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.142613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.142886 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.143159 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.143426 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.143691 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.143948 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.144136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.144289 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.144492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.144767 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.144973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.145187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.145399 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.145646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.146000 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.163097 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.163371 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.165209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.165500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.167865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.170049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.171447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.171731 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.173702 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.173998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.176634 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.179519 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.181026 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.183130 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.184588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.185268 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.185268 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.185699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.185699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.186070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.187248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.187553 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.187841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.188128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.188406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.188701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.205712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.205994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.206986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.206986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.209205 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.209604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.209873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.210137 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.214903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.216617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.216907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.218079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.219805 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.219976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.220138 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.220294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.220435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.220885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.221367 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.223392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.223673 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.224018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.224299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.224575 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.234639 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.234913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.235186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.235473 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.235745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.236009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.236286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.238089 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.238370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.238651 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.238943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.239224 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.240035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.240349 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.254778 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.258759 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.259164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.262031 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.262518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.263600 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.265236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.265629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.265890 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.266047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.267514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.269198 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.269478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.269772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.275110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.276661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.277605 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.279223 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.279908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.280195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.280471 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.280763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.282506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.282796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.283079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.283357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.291355 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.291649 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.291931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.293156 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.293467 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.293756 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.299857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.300136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.300419 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.300717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.300978 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.301257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.301539 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.301746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 13:57:42.301837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.303071 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.303071 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.303302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.303302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.303429 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.303720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.303870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.303949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.304015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.304251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.304337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.304401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.304462 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.304785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.305016 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.305290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.305576 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.305842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.306105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 13:57:42.343714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560ae66869c0 pid: 80058 (default app) May 16 13:57:42.346445 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560ae66869c0 pid: 80057 (default app) May 16 13:57:42.347663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6c703-d04e-4178-a192-c20c9893ee9a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:42.348000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6c703-d04e-4178-a192-c20c9893ee9a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:42.348279 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6c703-d04e-4178-a192-c20c9893ee9a None None] PATH_INFO: `/v3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:42.353118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Mon May 16 13:57:42 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:57:50.513461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61165f-74d0-450d-b240-e2203fb833bb None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:50.514084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61165f-74d0-450d-b240-e2203fb833bb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:50.514084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61165f-74d0-450d-b240-e2203fb833bb None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:50.518617 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:57:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:57:50.525865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:50.526613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:50.526613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:50.560510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 13:57:50.757174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG passlib.handlers.bcrypt [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80058) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 13:57:50.757754 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG passlib.handlers.bcrypt [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80058) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 13:57:50.817640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:57:50.819404 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:57:50.966205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:57:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 13:57:51.122218 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61165f-74d0-450d-b240-e2203fb833bb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:51.158017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG oslo_db.sqlalchemy.engines [None req-ee61165f-74d0-450d-b240-e2203fb833bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 13:57:51.294332 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61165f-74d0-450d-b240-e2203fb833bb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:51.299002 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bfc38-d1c3-4754-ac6d-da12c4af16c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4548a84ff35448d493ae9458aa7d0261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:51.299694 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bfc38-d1c3-4754-ac6d-da12c4af16c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:51.299978 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bfc38-d1c3-4754-ac6d-da12c4af16c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:51.300251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bfc38-d1c3-4754-ac6d-da12c4af16c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:51.309861 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bfc38-d1c3-4754-ac6d-da12c4af16c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:51.363227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: WARNING keystone.common.rbac_enforcer.enforcer [None req-318bfc38-d1c3-4754-ac6d-da12c4af16c4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 13:57:51.363570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bfc38-d1c3-4754-ac6d-da12c4af16c4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:51.374273 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Mon May 16 13:57:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 13:57:51.380468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:51.396828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3f7d1-26df-4923-b681-6de248ee6e95 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:51.402235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed87472-7e1a-4bab-be94-94cb41ebe198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4548a84ff35448d493ae9458aa7d0261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:51.403431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87472-7e1a-4bab-be94-94cb41ebe198 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:51.403711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87472-7e1a-4bab-be94-94cb41ebe198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:51.403983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87472-7e1a-4bab-be94-94cb41ebe198 admin admin] PATH_INFO: `/v3/projects/4548a84ff35448d493ae9458aa7d0261` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:51.405614 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed87472-7e1a-4bab-be94-94cb41ebe198 admin admin] RBAC: Authorizing `identity:get_project(project_id=4548a84ff35448d493ae9458aa7d0261)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:51.456704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6ed87472-7e1a-4bab-be94-94cb41ebe198 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 13:57:51.457062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed87472-7e1a-4bab-be94-94cb41ebe198 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:51.464597 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Mon May 16 13:57:51 2022] GET /identity/v3/projects/4548a84ff35448d493ae9458aa7d0261 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:57:53.775352 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd487ad-04ff-4e4e-b189-efbc2eb0ec7c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:53.775951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd487ad-04ff-4e4e-b189-efbc2eb0ec7c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:53.775951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd487ad-04ff-4e4e-b189-efbc2eb0ec7c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:53.780108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:57:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:57:53.786721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ad1f-bebb-4fff-b56e-2de891e1c457 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:53.787422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ad1f-bebb-4fff-b56e-2de891e1c457 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:53.787422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ad1f-bebb-4fff-b56e-2de891e1c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:53.921538 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e3d7ad1f-bebb-4fff-b56e-2de891e1c457 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:57:53.923067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e3d7ad1f-bebb-4fff-b56e-2de891e1c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:57:53.931395 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:57:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 13:57:53.954666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd487ad-04ff-4e4e-b189-efbc2eb0ec7c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:53.967768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd487ad-04ff-4e4e-b189-efbc2eb0ec7c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:53.972335 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6f113-82ed-4d54-b43c-aa8b8e723aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4548a84ff35448d493ae9458aa7d0261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:53.973039 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f113-82ed-4d54-b43c-aa8b8e723aad admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:53.974016 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f113-82ed-4d54-b43c-aa8b8e723aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:53.974422 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f113-82ed-4d54-b43c-aa8b8e723aad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:53.983012 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6f113-82ed-4d54-b43c-aa8b8e723aad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:53.984830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6f113-82ed-4d54-b43c-aa8b8e723aad admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:53.994700 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Mon May 16 13:57:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 13:57:54.000702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7ad1f-bebb-4fff-b56e-2de891e1c457 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:54.009973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7ad1f-bebb-4fff-b56e-2de891e1c457 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:54.014428 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39f420-c5d9-48e6-a77f-41a324bd7c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4548a84ff35448d493ae9458aa7d0261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:54.015301 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f420-c5d9-48e6-a77f-41a324bd7c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:54.015585 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f420-c5d9-48e6-a77f-41a324bd7c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:54.015861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f420-c5d9-48e6-a77f-41a324bd7c6a admin admin] PATH_INFO: `/v3/users/1fec58596ab24b6da85e57a855ed085a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:54.017322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39f420-c5d9-48e6-a77f-41a324bd7c6a admin admin] RBAC: Authorizing `identity:get_user(user_id=1fec58596ab24b6da85e57a855ed085a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:54.019192 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39f420-c5d9-48e6-a77f-41a324bd7c6a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:54.021655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Mon May 16 13:57:53 2022] GET /identity/v3/users/1fec58596ab24b6da85e57a855ed085a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:57:56.415179 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa77e7-e0b2-4293-b3db-d151fa184f34 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:56.415771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa77e7-e0b2-4293-b3db-d151fa184f34 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:56.415771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa77e7-e0b2-4293-b3db-d151fa184f34 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:56.417313 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:57:56.422832 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c347a7-3534-4ec0-a5d0-1e1a9ab92fa0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:56.423351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c347a7-3534-4ec0-a5d0-1e1a9ab92fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:56.423525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c347a7-3534-4ec0-a5d0-1e1a9ab92fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:56.441607 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-89c347a7-3534-4ec0-a5d0-1e1a9ab92fa0 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:57:56.442976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-89c347a7-3534-4ec0-a5d0-1e1a9ab92fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:57:56.546800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:57:56.571239 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa77e7-e0b2-4293-b3db-d151fa184f34 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:56.673968 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53517c-312e-448d-ad4e-803438fcb9a9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:56.674163 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53517c-312e-448d-ad4e-803438fcb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:56.674430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53517c-312e-448d-ad4e-803438fcb9a9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:56.676012 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 7/12] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:57:56.681651 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c38e3-5713-4dc0-a0be-b37d97f91854 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:56.681929 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c38e3-5713-4dc0-a0be-b37d97f91854 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:56.682208 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c38e3-5713-4dc0-a0be-b37d97f91854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:56.699298 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a68c38e3-5713-4dc0-a0be-b37d97f91854 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:57:56.700496 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a68c38e3-5713-4dc0-a0be-b37d97f91854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:57:56.725832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa77e7-e0b2-4293-b3db-d151fa184f34 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:56.760364 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c49f2-01df-4812-af47-b7383afddc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:56.761389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c49f2-01df-4812-af47-b7383afddc9e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:56.761672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c49f2-01df-4812-af47-b7383afddc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:56.761951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c49f2-01df-4812-af47-b7383afddc9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:56.771558 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 8/13] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:57:56.775526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c49f2-01df-4812-af47-b7383afddc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-011c49f2-01df-4812-af47-b7383afddc9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:57:56.787654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:57:56.788940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:57:56.789793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 6/14] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:57:56.793916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c38e3-5713-4dc0-a0be-b37d97f91854 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:56.795404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c49f2-01df-4812-af47-b7383afddc9e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:56.924077 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c49f2-01df-4812-af47-b7383afddc9e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:56.931420 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c38e3-5713-4dc0-a0be-b37d97f91854 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:56.960820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:56.961500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:56.961784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:56.962060 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:56.962818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:57:56.963121 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:56.964523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:56.967646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd4ce-ffc9-42a7-86ff-c258a9789a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:56.968305 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd4ce-ffc9-42a7-86ff-c258a9789a74 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:56.968587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd4ce-ffc9-42a7-86ff-c258a9789a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:56.968892 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd4ce-ffc9-42a7-86ff-c258a9789a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:56.977692 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 7/15] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:57:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:57:56.983365 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:57.035719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd4ce-ffc9-42a7-86ff-c258a9789a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:57.037280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd4ce-ffc9-42a7-86ff-c258a9789a74 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:57.080935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a659-5e6a-4e40-a4b9-590eac370682 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:57.116469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779a87-f648-4e76-836c-7400a6622872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:57.117321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779a87-f648-4e76-836c-7400a6622872 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:57.117602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779a87-f648-4e76-836c-7400a6622872 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:57.117874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779a87-f648-4e76-836c-7400a6622872 None admin] PATH_INFO: `/v3/users/1fec58596ab24b6da85e57a855ed085a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:57.119504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2779a87-f648-4e76-836c-7400a6622872 None admin] RBAC: Authorizing `identity:get_user(user_id=1fec58596ab24b6da85e57a855ed085a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:57.120986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2779a87-f648-4e76-836c-7400a6622872 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:57.122625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 8/16] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:57:56 2022] GET /identity/v3/users/1fec58596ab24b6da85e57a855ed085a => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:57:57.128035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779a87-f648-4e76-836c-7400a6622872 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:57.134014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 9/17] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:57:57.139740 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd4ce-ffc9-42a7-86ff-c258a9789a74 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:57.251814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd4ce-ffc9-42a7-86ff-c258a9789a74 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:57.289118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:57.290031 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:57.290308 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:57.290575 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:57.300642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:57.302686 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:57:57.324478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:57:57.326468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:57:57.328361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:57:57.328361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:57:57.328361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:57:57.328361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:57:57.328361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:57:57.332017 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:57.346421 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779a87-f648-4e76-836c-7400a6622872 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:57.381361 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537d829-7a1a-4bad-a43a-30380b27bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:57.382169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d829-7a1a-4bad-a43a-30380b27bfcd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:57.382453 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d829-7a1a-4bad-a43a-30380b27bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:57.382729 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d829-7a1a-4bad-a43a-30380b27bfcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:57.383995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537d829-7a1a-4bad-a43a-30380b27bfcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:57.385464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537d829-7a1a-4bad-a43a-30380b27bfcd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:57.387209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:57:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:57:57.392913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537d829-7a1a-4bad-a43a-30380b27bfcd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:57:57.432946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c34ec-c8bb-4340-bffa-9d30e1d08a09 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:57.471250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8710e00-068a-4fb7-b755-254ee18cbd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:57.471920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710e00-068a-4fb7-b755-254ee18cbd3b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:57.472203 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710e00-068a-4fb7-b755-254ee18cbd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:57.472481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710e00-068a-4fb7-b755-254ee18cbd3b None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:57.474359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8710e00-068a-4fb7-b755-254ee18cbd3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:57:57.474681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8710e00-068a-4fb7-b755-254ee18cbd3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:57.476084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8710e00-068a-4fb7-b755-254ee18cbd3b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:57.494276 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:57:57.500211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537d829-7a1a-4bad-a43a-30380b27bfcd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:57:57.540391 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2739e-2534-4768-9419-c1e3065ae27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:57:57.540816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2739e-2534-4768-9419-c1e3065ae27a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:57:57.541108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2739e-2534-4768-9419-c1e3065ae27a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:57:57.541382 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2739e-2534-4768-9419-c1e3065ae27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:57:57.542242 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2739e-2534-4768-9419-c1e3065ae27a None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.domain.id=default, user.id=1fec58596ab24b6da85e57a855ed085a) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:57:57.542552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2739e-2534-4768-9419-c1e3065ae27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:57:57.544041 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2739e-2534-4768-9419-c1e3065ae27a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:57:57.554753 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1322 bytes} [Mon May 16 13:57:57 2022] GET /identity/v3/role_assignments?user.id=1fec58596ab24b6da85e57a855ed085a&scope.domain.id=default&role.id=52bf3a299728408b8384e30e08547fd8 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:01.324610 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b4122-0594-4b3c-b080-b86b9fc2b344 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:01.325923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b4122-0594-4b3c-b080-b86b9fc2b344 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:01.326638 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b4122-0594-4b3c-b080-b86b9fc2b344 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:01.333923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:01.339626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5ae9-792e-4101-bbe9-54d1138ff175 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:01.340883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5ae9-792e-4101-bbe9-54d1138ff175 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:01.341589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5ae9-792e-4101-bbe9-54d1138ff175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:01.384519 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG passlib.handlers.bcrypt [None req-37ab5ae9-792e-4101-bbe9-54d1138ff175 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80057) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 13:58:01.385565 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG passlib.handlers.bcrypt [None req-37ab5ae9-792e-4101-bbe9-54d1138ff175 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80057) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 13:58:01.454667 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-37ab5ae9-792e-4101-bbe9-54d1138ff175 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:01.458286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-37ab5ae9-792e-4101-bbe9-54d1138ff175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:01.645945 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:01.679834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b4122-0594-4b3c-b080-b86b9fc2b344 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:01.698975 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7a21-c60f-4f30-84ae-6019744252ef None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:01.699783 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7a21-c60f-4f30-84ae-6019744252ef None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:01.700482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7a21-c60f-4f30-84ae-6019744252ef None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:01.702987 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:01.710107 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3326-b12d-4a26-a4f1-67f2f953eb05 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:01.710852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3326-b12d-4a26-a4f1-67f2f953eb05 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:01.711515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3326-b12d-4a26-a4f1-67f2f953eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:01.762264 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f59f3326-b12d-4a26-a4f1-67f2f953eb05 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:01.764532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f59f3326-b12d-4a26-a4f1-67f2f953eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:01.901320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b4122-0594-4b3c-b080-b86b9fc2b344 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:01.955482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:01.959333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e976-ad82-43a9-88da-cba3c4807a10 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:01.959803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e976-ad82-43a9-88da-cba3c4807a10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:01.960289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94e976-ad82-43a9-88da-cba3c4807a10 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:01.964798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:01.966187 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:01.966696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:01.967205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:01.971610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 14/26] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:01 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:01.991321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec12f1-8e72-4bca-b2b8-9429b73c5931 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:01.991794 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec12f1-8e72-4bca-b2b8-9429b73c5931 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:01.992256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec12f1-8e72-4bca-b2b8-9429b73c5931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:01.994327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:01.997261 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:58:02.031567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:02.033008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:02.034368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:58:02.034368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:58:02.034368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:58:02.034368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:02.034368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 13/27] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:02.035613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:02.040168 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4aec12f1-8e72-4bca-b2b8-9429b73c5931 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:02.042483 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4aec12f1-8e72-4bca-b2b8-9429b73c5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:02.151933 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 15/28] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:02.152889 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec12f1-8e72-4bca-b2b8-9429b73c5931 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:02.261356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e6141-33b1-4177-b52a-fcf73407b6a6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:02.263176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec12f1-8e72-4bca-b2b8-9429b73c5931 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:02.301841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa852aa-ff82-449f-8e39-1c46e523dee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:02.302669 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa852aa-ff82-449f-8e39-1c46e523dee0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:02.303075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa852aa-ff82-449f-8e39-1c46e523dee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:02.303357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa852aa-ff82-449f-8e39-1c46e523dee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:02.304086 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa852aa-ff82-449f-8e39-1c46e523dee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:02.304388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa852aa-ff82-449f-8e39-1c46e523dee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:02.306015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa852aa-ff82-449f-8e39-1c46e523dee0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:02.319653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44707d84-5eab-43f0-b4da-5bc8a84e460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:02.320969 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44707d84-5eab-43f0-b4da-5bc8a84e460f None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:02.321570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44707d84-5eab-43f0-b4da-5bc8a84e460f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:02.322158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44707d84-5eab-43f0-b4da-5bc8a84e460f None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:02.323673 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44707d84-5eab-43f0-b4da-5bc8a84e460f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:02.326407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44707d84-5eab-43f0-b4da-5bc8a84e460f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:02.330084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 16/29] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:02.336272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea9a3-8ae0-4a1d-893d-80965057a787 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:02.336917 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea9a3-8ae0-4a1d-893d-80965057a787 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:02.337341 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea9a3-8ae0-4a1d-893d-80965057a787 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:02.339034 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 17/30] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:02.339925 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea9a3-8ae0-4a1d-893d-80965057a787 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:02.455736 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea9a3-8ae0-4a1d-893d-80965057a787 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:02.490887 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 14/31] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 13:58:02 2022] POST /identity/v3/roles => generated 219 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:02.491921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44707d84-5eab-43f0-b4da-5bc8a84e460f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:02.502315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7be296-ef1a-4a7b-a5b7-e25cbc47f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:02.503516 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be296-ef1a-4a7b-a5b7-e25cbc47f9ff None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:02.504180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be296-ef1a-4a7b-a5b7-e25cbc47f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:02.504744 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be296-ef1a-4a7b-a5b7-e25cbc47f9ff None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:02.505855 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7be296-ef1a-4a7b-a5b7-e25cbc47f9ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:02.507654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7be296-ef1a-4a7b-a5b7-e25cbc47f9ff None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:02.623774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44707d84-5eab-43f0-b4da-5bc8a84e460f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:02.669424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459de63-f8df-4edc-8458-83b9e54200ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:02.670104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459de63-f8df-4edc-8458-83b9e54200ba None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:02.670394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459de63-f8df-4edc-8458-83b9e54200ba None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:02.670677 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459de63-f8df-4edc-8458-83b9e54200ba None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:02.671497 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459de63-f8df-4edc-8458-83b9e54200ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:02.673616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459de63-f8df-4edc-8458-83b9e54200ba None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:02.681084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 18/32] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 13:58:02 2022] POST /identity/v3/roles => generated 225 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:02.684192 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cc25-83bc-49e7-bd7d-082a7b17462a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:02.685175 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cc25-83bc-49e7-bd7d-082a7b17462a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:02.685895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cc25-83bc-49e7-bd7d-082a7b17462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:02.710810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-91d3cc25-83bc-49e7-bd7d-082a7b17462a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:02.712960 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-91d3cc25-83bc-49e7-bd7d-082a7b17462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:02.752549 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 15/33] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 13:58:02 2022] POST /identity/v3/projects => generated 301 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:02.754772 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc45e4-0b9f-4b0d-906b-6ce387975ea7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:02.755225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc45e4-0b9f-4b0d-906b-6ce387975ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:02.755511 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc45e4-0b9f-4b0d-906b-6ce387975ea7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:02.757328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 16/34] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:02.763385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadea6-a1c8-436b-9dba-15de76b58180 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:02.763699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadea6-a1c8-436b-9dba-15de76b58180 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:02.763943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadea6-a1c8-436b-9dba-15de76b58180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:02.785241 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5eaadea6-a1c8-436b-9dba-15de76b58180 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:02.787339 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5eaadea6-a1c8-436b-9dba-15de76b58180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:02.869912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 17/35] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:02.915049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 19/36] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:02.927730 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaadea6-a1c8-436b-9dba-15de76b58180 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:02.976932 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cc25-83bc-49e7-bd7d-082a7b17462a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:03.102267 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaadea6-a1c8-436b-9dba-15de76b58180 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:03.129691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cc25-83bc-49e7-bd7d-082a7b17462a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:03.151118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756505e1-60db-4f49-afad-d26259c12673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:03.152399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756505e1-60db-4f49-afad-d26259c12673 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.153034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756505e1-60db-4f49-afad-d26259c12673 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.153619 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756505e1-60db-4f49-afad-d26259c12673 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.155007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756505e1-60db-4f49-afad-d26259c12673 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:03.157430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756505e1-60db-4f49-afad-d26259c12673 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:03.172975 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0b66e-e30e-40d3-8224-293924fb9ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:03.174026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b66e-e30e-40d3-8224-293924fb9ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.174477 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b66e-e30e-40d3-8224-293924fb9ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.174883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b66e-e30e-40d3-8224-293924fb9ed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.175332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 13:58:02 2022] POST /identity/v3/roles => generated 223 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:03.177319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef159-ca54-4703-b9a7-0e60d2a22242 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.177673 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef159-ca54-4703-b9a7-0e60d2a22242 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.177940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef159-ca54-4703-b9a7-0e60d2a22242 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.179555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 19/38] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:03.185538 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addccbd-b470-40d0-984c-f43b12630673 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.185927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addccbd-b470-40d0-984c-f43b12630673 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.186185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addccbd-b470-40d0-984c-f43b12630673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.190254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0b66e-e30e-40d3-8224-293924fb9ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a4c0b66e-e30e-40d3-8224-293924fb9ed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:03.199262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:03.200208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:03.201444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 20/39] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:03.208884 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0b66e-e30e-40d3-8224-293924fb9ed5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:03.209941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4addccbd-b470-40d0-984c-f43b12630673 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:03.211222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4addccbd-b470-40d0-984c-f43b12630673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:03.297268 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 20/40] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:03.322035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addccbd-b470-40d0-984c-f43b12630673 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:03.355466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0b66e-e30e-40d3-8224-293924fb9ed5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:03.398128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:03.398128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.398128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.398128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.398648 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:03.398761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:03.400229 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:03.415498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 21/41] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:03.417861 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:03.445993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addccbd-b470-40d0-984c-f43b12630673 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:03.482750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b024f3f-9d4d-4da4-ac7c-5a3a5ce2511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:03.483565 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b024f3f-9d4d-4da4-ac7c-5a3a5ce2511c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.483853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b024f3f-9d4d-4da4-ac7c-5a3a5ce2511c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.484131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b024f3f-9d4d-4da4-ac7c-5a3a5ce2511c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.485356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b024f3f-9d4d-4da4-ac7c-5a3a5ce2511c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:03.486812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b024f3f-9d4d-4da4-ac7c-5a3a5ce2511c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:03.489446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 21/42] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:03.495332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b024f3f-9d4d-4da4-ac7c-5a3a5ce2511c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:03.542914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee9a7-7586-49e9-8fc3-404b809ecb29 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:03.577410 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c8b0-ba8a-4b1d-b14d-af83aacbc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:03.578209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c8b0-ba8a-4b1d-b14d-af83aacbc182 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.578512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c8b0-ba8a-4b1d-b14d-af83aacbc182 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.578770 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c8b0-ba8a-4b1d-b14d-af83aacbc182 None admin] PATH_INFO: `/v3/users/1fec58596ab24b6da85e57a855ed085a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.580478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413c8b0-ba8a-4b1d-b14d-af83aacbc182 None admin] RBAC: Authorizing `identity:get_user(user_id=1fec58596ab24b6da85e57a855ed085a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:03.581995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413c8b0-ba8a-4b1d-b14d-af83aacbc182 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:03.584133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:03 2022] GET /identity/v3/users/1fec58596ab24b6da85e57a855ed085a => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:03.589573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c8b0-ba8a-4b1d-b14d-af83aacbc182 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:03.595493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b024f3f-9d4d-4da4-ac7c-5a3a5ce2511c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:03.629969 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f801f0-6e28-491b-bfc9-454140090577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:03.630636 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f801f0-6e28-491b-bfc9-454140090577 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.630914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f801f0-6e28-491b-bfc9-454140090577 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.631182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f801f0-6e28-491b-bfc9-454140090577 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.631888 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f801f0-6e28-491b-bfc9-454140090577 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:03.633386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f801f0-6e28-491b-bfc9-454140090577 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:03.657562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 13:58:03 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 13:58:03.695305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c8b0-ba8a-4b1d-b14d-af83aacbc182 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:03.732639 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfebea7-7379-42f3-81bb-ab067856b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:03.734926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfebea7-7379-42f3-81bb-ab067856b58e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.734926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfebea7-7379-42f3-81bb-ab067856b58e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.734926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfebea7-7379-42f3-81bb-ab067856b58e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.735337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfebea7-7379-42f3-81bb-ab067856b58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:03.736875 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfebea7-7379-42f3-81bb-ab067856b58e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:03.739164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 23/45] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:03.745561 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f801f0-6e28-491b-bfc9-454140090577 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:03.853788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f801f0-6e28-491b-bfc9-454140090577 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:03.889028 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a504e-4f46-4db3-bb54-ef6402d6377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:03.890527 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a504e-4f46-4db3-bb54-ef6402d6377b None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:03.890994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a504e-4f46-4db3-bb54-ef6402d6377b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:03.891467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a504e-4f46-4db3-bb54-ef6402d6377b None admin] PATH_INFO: `/v3/domains/default/users/1fec58596ab24b6da85e57a855ed085a/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:03.894817 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a504e-4f46-4db3-bb54-ef6402d6377b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1fec58596ab24b6da85e57a855ed085a, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:03.897692 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a504e-4f46-4db3-bb54-ef6402d6377b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:03.919493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 23/46] 10.222.0.13 () {58 vars in 1361 bytes} [Mon May 16 13:58:03 2022] PUT /identity/v3/domains/default/users/1fec58596ab24b6da85e57a855ed085a/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:05.930854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4e198-c020-4957-929b-82075f80713b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:05.931372 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4e198-c020-4957-929b-82075f80713b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:05.931372 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4e198-c020-4957-929b-82075f80713b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:05.932785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:05.938036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d361-843c-45d7-8710-1e4860451951 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:05.938476 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d361-843c-45d7-8710-1e4860451951 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:05.938603 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d361-843c-45d7-8710-1e4860451951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:05.959032 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-93f4d361-843c-45d7-8710-1e4860451951 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:05.960359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-93f4d361-843c-45d7-8710-1e4860451951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:06.038303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:06.064222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4e198-c020-4957-929b-82075f80713b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:06.150585 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3df9-f466-4c1d-8807-c9e72b210f79 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:06.150883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3df9-f466-4c1d-8807-c9e72b210f79 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:06.151181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3df9-f466-4c1d-8807-c9e72b210f79 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:06.152971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 25/49] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:06.159425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dbf6-1782-4230-8cab-d6191ea63a0e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:06.159629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dbf6-1782-4230-8cab-d6191ea63a0e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:06.159910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dbf6-1782-4230-8cab-d6191ea63a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:06.173010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4e198-c020-4957-929b-82075f80713b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:06.180463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3119dbf6-1782-4230-8cab-d6191ea63a0e None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:06.181711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3119dbf6-1782-4230-8cab-d6191ea63a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:06.212032 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2a37d-24e8-43b8-afb2-d437f794228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:06.212876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a37d-24e8-43b8-afb2-d437f794228b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:06.213169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a37d-24e8-43b8-afb2-d437f794228b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:06.213449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a37d-24e8-43b8-afb2-d437f794228b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:06.214654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2a37d-24e8-43b8-afb2-d437f794228b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:06.216118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2a37d-24e8-43b8-afb2-d437f794228b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:06.217811 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 25/50] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:06.224383 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2a37d-24e8-43b8-afb2-d437f794228b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:06.259534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 26/51] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:06.283602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119dbf6-1782-4230-8cab-d6191ea63a0e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:06.320607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2a37d-24e8-43b8-afb2-d437f794228b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:06.353674 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290738-14a2-4128-8bd7-ef98294e9064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:06.354342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290738-14a2-4128-8bd7-ef98294e9064 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:06.354634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290738-14a2-4128-8bd7-ef98294e9064 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:06.354905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290738-14a2-4128-8bd7-ef98294e9064 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:06.355624 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7290738-14a2-4128-8bd7-ef98294e9064 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:06.357125 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7290738-14a2-4128-8bd7-ef98294e9064 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:06.389288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119dbf6-1782-4230-8cab-d6191ea63a0e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:06.393144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1140 bytes} [Mon May 16 13:58:06 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 13:58:06.442883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c23583-9231-4d75-af13-12543de1ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:06.443702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23583-9231-4d75-af13-12543de1ee4f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:06.444058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23583-9231-4d75-af13-12543de1ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:06.444407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23583-9231-4d75-af13-12543de1ee4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:06.458071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c23583-9231-4d75-af13-12543de1ee4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e3c23583-9231-4d75-af13-12543de1ee4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:06.467102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:06.468044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:06.469068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:06.476025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290738-14a2-4128-8bd7-ef98294e9064 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:06.588972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290738-14a2-4128-8bd7-ef98294e9064 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:06.625612 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:06.626300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:06.626587 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:06.626866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:06.627629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:06.627938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:06.629509 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:06.638726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 27/54] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:06.644484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c23583-9231-4d75-af13-12543de1ee4f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:06.742223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c23583-9231-4d75-af13-12543de1ee4f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:06.774640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1126-a66c-404d-aab4-d1b2187b79e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:06.775513 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1126-a66c-404d-aab4-d1b2187b79e9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:06.775795 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1126-a66c-404d-aab4-d1b2187b79e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:06.776072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1126-a66c-404d-aab4-d1b2187b79e9 None admin] PATH_INFO: `/v3/users/1fec58596ab24b6da85e57a855ed085a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:06.777310 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e1126-a66c-404d-aab4-d1b2187b79e9 None admin] RBAC: Authorizing `identity:get_user(user_id=1fec58596ab24b6da85e57a855ed085a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:06.778764 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e1126-a66c-404d-aab4-d1b2187b79e9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:06.780383 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:06 2022] GET /identity/v3/users/1fec58596ab24b6da85e57a855ed085a => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:06.786008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:06.885125 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ba09-693a-4572-9f1a-dd78ecaf443c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:06.917303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fd1c-f226-417d-91aa-258e7284bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:06.918104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fd1c-f226-417d-91aa-258e7284bf66 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:06.918389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fd1c-f226-417d-91aa-258e7284bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:06.918667 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fd1c-f226-417d-91aa-258e7284bf66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:06.919834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657fd1c-f226-417d-91aa-258e7284bf66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:06.921388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657fd1c-f226-417d-91aa-258e7284bf66 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:06.922996 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 28/56] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:06.929238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1126-a66c-404d-aab4-d1b2187b79e9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:07.028698 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1126-a66c-404d-aab4-d1b2187b79e9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:07.061599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f32fc-4544-422c-bbd9-363a558e1a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:07.062253 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f32fc-4544-422c-bbd9-363a558e1a51 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:07.062539 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f32fc-4544-422c-bbd9-363a558e1a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:07.062817 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f32fc-4544-422c-bbd9-363a558e1a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:07.063649 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f32fc-4544-422c-bbd9-363a558e1a51 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.domain.id=default, user.id=1fec58596ab24b6da85e57a855ed085a) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:07.063960 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f32fc-4544-422c-bbd9-363a558e1a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:07.065444 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f32fc-4544-422c-bbd9-363a558e1a51 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:07.072890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1322 bytes} [Mon May 16 13:58:06 2022] GET /identity/v3/role_assignments?user.id=1fec58596ab24b6da85e57a855ed085a&scope.domain.id=default&role.id=52bf3a299728408b8384e30e08547fd8 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:08.745252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fdc5e-23c8-4f30-b5c3-4636a33cab65 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:08.745804 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fdc5e-23c8-4f30-b5c3-4636a33cab65 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:08.745804 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fdc5e-23c8-4f30-b5c3-4636a33cab65 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:08.747287 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 29/58] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:08.752909 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d681-3cbc-4138-88d5-c854f58b6266 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:08.753377 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d681-3cbc-4138-88d5-c854f58b6266 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:08.753463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d681-3cbc-4138-88d5-c854f58b6266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:08.771494 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0508d681-3cbc-4138-88d5-c854f58b6266 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:08.772702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0508d681-3cbc-4138-88d5-c854f58b6266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:08.841320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:08.868544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fdc5e-23c8-4f30-b5c3-4636a33cab65 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:08.983271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fdc5e-23c8-4f30-b5c3-4636a33cab65 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:09.022879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a682cf0-27c9-447a-9aae-e01aa624d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:09.023796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a682cf0-27c9-447a-9aae-e01aa624d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:09.024131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a682cf0-27c9-447a-9aae-e01aa624d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:09.024435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a682cf0-27c9-447a-9aae-e01aa624d4d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:09.025915 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a682cf0-27c9-447a-9aae-e01aa624d4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:09.027514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a682cf0-27c9-447a-9aae-e01aa624d4d3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:09.029415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 30/60] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:09.037995 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d681-3cbc-4138-88d5-c854f58b6266 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:09.143987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d681-3cbc-4138-88d5-c854f58b6266 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:09.181811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f95c0f-8a86-4ef7-89d7-1b9d93110dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:09.182476 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f95c0f-8a86-4ef7-89d7-1b9d93110dda None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:09.182757 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f95c0f-8a86-4ef7-89d7-1b9d93110dda None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:09.183025 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f95c0f-8a86-4ef7-89d7-1b9d93110dda None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:09.183736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f95c0f-8a86-4ef7-89d7-1b9d93110dda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:09.185749 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f95c0f-8a86-4ef7-89d7-1b9d93110dda None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:09.213570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:58:09 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:12.917777 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e4053-43dc-4cc1-8bc6-4e1a4bb280a3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:12.918267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e4053-43dc-4cc1-8bc6-4e1a4bb280a3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:12.918339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e4053-43dc-4cc1-8bc6-4e1a4bb280a3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:12.919937 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 31/62] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:12.941370 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1b747-ac08-457f-9ba5-02c669670e83 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:12.942287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1b747-ac08-457f-9ba5-02c669670e83 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:12.942715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1b747-ac08-457f-9ba5-02c669670e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:12.971119 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-85f1b747-ac08-457f-9ba5-02c669670e83 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:12.972642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-85f1b747-ac08-457f-9ba5-02c669670e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:13.082774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 32/63] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:13.117898 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e4053-43dc-4cc1-8bc6-4e1a4bb280a3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:13.207457 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26eb56-4135-4f2d-a136-967429bd35cf None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.207666 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26eb56-4135-4f2d-a136-967429bd35cf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.208109 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26eb56-4135-4f2d-a136-967429bd35cf None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.209831 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 33/64] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:13.215696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0d8b1-1a85-4484-b67c-387169bca1cf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.216165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0d8b1-1a85-4484-b67c-387169bca1cf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.216590 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0d8b1-1a85-4484-b67c-387169bca1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.246638 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dce0d8b1-1a85-4484-b67c-387169bca1cf None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:13.248093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dce0d8b1-1a85-4484-b67c-387169bca1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:13.265441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e4053-43dc-4cc1-8bc6-4e1a4bb280a3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:13.318668 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3967f9-4d3e-4572-b90a-256aae918796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:13.319495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3967f9-4d3e-4572-b90a-256aae918796 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.319779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3967f9-4d3e-4572-b90a-256aae918796 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.320055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3967f9-4d3e-4572-b90a-256aae918796 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.331031 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3967f9-4d3e-4572-b90a-256aae918796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8c3967f9-4d3e-4572-b90a-256aae918796 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:13.339610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:13.340728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:13.341611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:13.343507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 32/65] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:13.348796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb88d5-6cab-4b12-8492-3d35559a56ab None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.348796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb88d5-6cab-4b12-8492-3d35559a56ab None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.348796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb88d5-6cab-4b12-8492-3d35559a56ab None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.349322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 33/66] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:13.352827 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 34/67] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:13.352960 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb88d5-6cab-4b12-8492-3d35559a56ab None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:13.356914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28f9e7-ed45-4780-9c00-e859656fd9fb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.357512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28f9e7-ed45-4780-9c00-e859656fd9fb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.358013 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28f9e7-ed45-4780-9c00-e859656fd9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.386377 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8b28f9e7-ed45-4780-9c00-e859656fd9fb None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:13.387961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8b28f9e7-ed45-4780-9c00-e859656fd9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:13.476199 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 35/68] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:13.477010 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28f9e7-ed45-4780-9c00-e859656fd9fb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:13.502352 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb88d5-6cab-4b12-8492-3d35559a56ab None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:13.543646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:13.544754 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.545240 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.545709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.546758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:13.547258 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:13.548909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:13.559113 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:13.560270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:13.588438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28f9e7-ed45-4780-9c00-e859656fd9fb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:13.623029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea452825-de3b-4550-a858-890adc379bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:13.623830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452825-de3b-4550-a858-890adc379bfa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.624108 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452825-de3b-4550-a858-890adc379bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.624378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452825-de3b-4550-a858-890adc379bfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.635886 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea452825-de3b-4550-a858-890adc379bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ea452825-de3b-4550-a858-890adc379bfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:13.643628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:13.645062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:13.646236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:13.646923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4b42-dc44-42ec-9249-555c00a9823d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.647574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4b42-dc44-42ec-9249-555c00a9823d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.647574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4b42-dc44-42ec-9249-555c00a9823d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.653059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 37/71] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:13.653059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af4b42-dc44-42ec-9249-555c00a9823d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:13.682366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c82ca9-2530-4ee2-a4dc-0551af140b99 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:13.719625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799216b-cfb8-48eb-a9ac-01140c7cc983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:13.720477 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799216b-cfb8-48eb-a9ac-01140c7cc983 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.721048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799216b-cfb8-48eb-a9ac-01140c7cc983 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.721339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799216b-cfb8-48eb-a9ac-01140c7cc983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.731866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799216b-cfb8-48eb-a9ac-01140c7cc983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c799216b-cfb8-48eb-a9ac-01140c7cc983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:13.741787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:13.742726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:13.743547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:13.744180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 35/72] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:58:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:13.745131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799216b-cfb8-48eb-a9ac-01140c7cc983 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:13.781474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af4b42-dc44-42ec-9249-555c00a9823d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:13.843082 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81468f-8419-4e10-9c8c-c8d6513f1764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:13.844528 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81468f-8419-4e10-9c8c-c8d6513f1764 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.845025 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81468f-8419-4e10-9c8c-c8d6513f1764 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.845501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81468f-8419-4e10-9c8c-c8d6513f1764 None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.871192 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81468f-8419-4e10-9c8c-c8d6513f1764 None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:13.873886 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81468f-8419-4e10-9c8c-c8d6513f1764 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:13.876904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 38/73] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:13 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:13.879707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc1b1-bae1-4b2a-8643-aa706e5397db None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.880111 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc1b1-bae1-4b2a-8643-aa706e5397db None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.880603 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc1b1-bae1-4b2a-8643-aa706e5397db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.897693 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799216b-cfb8-48eb-a9ac-01140c7cc983 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:13.898207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eb8dc1b1-bae1-4b2a-8643-aa706e5397db None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:13.901619 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eb8dc1b1-bae1-4b2a-8643-aa706e5397db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:13.932087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:13.932798 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.933087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.933365 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.934123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:13.934433 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:13.936110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:13.945497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 36/74] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:13.946516 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:13.966729 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 39/75] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:13.968064 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7033c-dc1f-4430-8600-9f6144ed2ba9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:13.968352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7033c-dc1f-4430-8600-9f6144ed2ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:13.968894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7033c-dc1f-4430-8600-9f6144ed2ba9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:13.970472 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 40/76] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:13.971489 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7033c-dc1f-4430-8600-9f6144ed2ba9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.043958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199da32-b5ae-44a7-b5e9-69dedc53d0c6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.076375 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.077095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.077382 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.077665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.078418 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:14.078721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:14.080095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:14.086179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7033c-dc1f-4430-8600-9f6144ed2ba9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.089063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 37/77] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:58:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:14.089879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.134950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48275a7a-d937-47d8-9856-65a6b64617bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.135615 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275a7a-d937-47d8-9856-65a6b64617bd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.135901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275a7a-d937-47d8-9856-65a6b64617bd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.136176 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275a7a-d937-47d8-9856-65a6b64617bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.190594 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc530f6-7d84-4d22-a9d5-e53142923c03 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.204977 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48275a7a-d937-47d8-9856-65a6b64617bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:14.206466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48275a7a-d937-47d8-9856-65a6b64617bd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:14.225857 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813737a-f6c5-4fb2-8d7b-73e9df940ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.226738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813737a-f6c5-4fb2-8d7b-73e9df940ffa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.227021 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813737a-f6c5-4fb2-8d7b-73e9df940ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.227301 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813737a-f6c5-4fb2-8d7b-73e9df940ffa None admin] PATH_INFO: `/v3/users/1fec58596ab24b6da85e57a855ed085a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.228539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813737a-f6c5-4fb2-8d7b-73e9df940ffa None admin] RBAC: Authorizing `identity:get_user(user_id=1fec58596ab24b6da85e57a855ed085a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:14.230035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813737a-f6c5-4fb2-8d7b-73e9df940ffa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:14.235144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 38/78] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/users/1fec58596ab24b6da85e57a855ed085a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:14.235144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050f1db-d876-46ee-9db8-bb1bc70b9547 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.235144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050f1db-d876-46ee-9db8-bb1bc70b9547 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.235144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050f1db-d876-46ee-9db8-bb1bc70b9547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.252537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e050f1db-d876-46ee-9db8-bb1bc70b9547 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:14.254377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e050f1db-d876-46ee-9db8-bb1bc70b9547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:14.310400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 41/79] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:14.311493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48275a7a-d937-47d8-9856-65a6b64617bd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.320597 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 39/80] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:14.321486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050f1db-d876-46ee-9db8-bb1bc70b9547 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.409344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48275a7a-d937-47d8-9856-65a6b64617bd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.427698 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050f1db-d876-46ee-9db8-bb1bc70b9547 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.445513 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d65e94-1ff9-467a-9057-88faf75ae4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.446325 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d65e94-1ff9-467a-9057-88faf75ae4fb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.446606 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d65e94-1ff9-467a-9057-88faf75ae4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.446880 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d65e94-1ff9-467a-9057-88faf75ae4fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.457771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d65e94-1ff9-467a-9057-88faf75ae4fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-52d65e94-1ff9-467a-9057-88faf75ae4fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:14.466618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:14.467705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 42/81] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:14.468961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d65e94-1ff9-467a-9057-88faf75ae4fb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.479586 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6f132-57df-42a7-9240-4ff24d67b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.480800 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f132-57df-42a7-9240-4ff24d67b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.481234 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f132-57df-42a7-9240-4ff24d67b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.481686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f132-57df-42a7-9240-4ff24d67b8f8 None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.483514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6f132-57df-42a7-9240-4ff24d67b8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:14.485481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6f132-57df-42a7-9240-4ff24d67b8f8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:14.487702 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 40/82] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:14.489146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6f132-57df-42a7-9240-4ff24d67b8f8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.595223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d65e94-1ff9-467a-9057-88faf75ae4fb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.617799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6f132-57df-42a7-9240-4ff24d67b8f8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.631677 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6646a-14e5-41fb-b8f5-0669c9b8bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.632349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6646a-14e5-41fb-b8f5-0669c9b8bc53 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.632634 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6646a-14e5-41fb-b8f5-0669c9b8bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.632947 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6646a-14e5-41fb-b8f5-0669c9b8bc53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.653218 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151263a7-cfea-4069-8010-8e67835d7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.654095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151263a7-cfea-4069-8010-8e67835d7b46 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.654375 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151263a7-cfea-4069-8010-8e67835d7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.654649 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151263a7-cfea-4069-8010-8e67835d7b46 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.655864 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151263a7-cfea-4069-8010-8e67835d7b46 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:14.657377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151263a7-cfea-4069-8010-8e67835d7b46 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:14.659094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 41/83] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:14.659889 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151263a7-cfea-4069-8010-8e67835d7b46 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.702179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6646a-14e5-41fb-b8f5-0669c9b8bc53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:14.703690 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6646a-14e5-41fb-b8f5-0669c9b8bc53 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:14.759344 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151263a7-cfea-4069-8010-8e67835d7b46 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.791827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c7f9b-b7ca-4b5a-acfb-196320f45d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.792626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7f9b-b7ca-4b5a-acfb-196320f45d36 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.792935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7f9b-b7ca-4b5a-acfb-196320f45d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.793213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7f9b-b7ca-4b5a-acfb-196320f45d36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.794404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c7f9b-b7ca-4b5a-acfb-196320f45d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:14.795835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c7f9b-b7ca-4b5a-acfb-196320f45d36 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:14.797650 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 42/84] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:14.798331 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c7f9b-b7ca-4b5a-acfb-196320f45d36 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.798764 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 43/85] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:14.799600 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6646a-14e5-41fb-b8f5-0669c9b8bc53 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:14.895451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c7f9b-b7ca-4b5a-acfb-196320f45d36 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.899175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6646a-14e5-41fb-b8f5-0669c9b8bc53 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:14.929349 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.930025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.930307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.930581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.931329 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:14.931636 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:14.933032 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:14.933573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07422197-68da-4759-ac13-350279fd4ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:14.933845 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07422197-68da-4759-ac13-350279fd4ccf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:14.934131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07422197-68da-4759-ac13-350279fd4ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:14.934449 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07422197-68da-4759-ac13-350279fd4ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:14.942005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 43/86] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:14.942874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:15.007665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07422197-68da-4759-ac13-350279fd4ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.009179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07422197-68da-4759-ac13-350279fd4ccf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:15.040338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8082-4cbf-49d3-a606-70863aecadb8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:15.073200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:15.073852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:15.074141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:15.074417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:15.075248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] RBAC: Adding query filter params (role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c, user.id=d312d466cfd04c698b6812ee7c7c1fdc) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:15.075559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.077032 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:15.082751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 44/87] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/role_assignments?user.id=d312d466cfd04c698b6812ee7c7c1fdc&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:15.083167 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:15.112525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 44/88] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:15.112525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07422197-68da-4759-ac13-350279fd4ccf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:15.197475 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d5d13-a5fb-4b0a-a3c3-5fd971de9239 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:15.226042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07422197-68da-4759-ac13-350279fd4ccf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:15.234742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554345d6-e606-4abd-8066-e30679d4dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:15.235439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554345d6-e606-4abd-8066-e30679d4dac5 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:15.235727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554345d6-e606-4abd-8066-e30679d4dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:15.236007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554345d6-e606-4abd-8066-e30679d4dac5 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:15.236767 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554345d6-e606-4abd-8066-e30679d4dac5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.238766 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554345d6-e606-4abd-8066-e30679d4dac5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:15.268025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 45/89] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:58:15 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:15.274352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4511-39be-4d23-bc76-b4772d799fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:15.274660 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4511-39be-4d23-bc76-b4772d799fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:15.274980 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4511-39be-4d23-bc76-b4772d799fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:15.275363 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4511-39be-4d23-bc76-b4772d799fd7 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:15.277638 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc4511-39be-4d23-bc76-b4772d799fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.277818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554345d6-e606-4abd-8066-e30679d4dac5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:15.279668 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc4511-39be-4d23-bc76-b4772d799fd7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:15.288711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 45/90] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:15 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:15.288711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4511-39be-4d23-bc76-b4772d799fd7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:15.406938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4511-39be-4d23-bc76-b4772d799fd7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:15.416362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554345d6-e606-4abd-8066-e30679d4dac5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:15.447887 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79bfed-d6e1-48fe-845e-7bbe0ee99708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:15.448715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bfed-d6e1-48fe-845e-7bbe0ee99708 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:15.449005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bfed-d6e1-48fe-845e-7bbe0ee99708 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:15.449284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bfed-d6e1-48fe-845e-7bbe0ee99708 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:15.450581 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79bfed-d6e1-48fe-845e-7bbe0ee99708 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.452079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79bfed-d6e1-48fe-845e-7bbe0ee99708 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:15.459589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 46/91] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:15 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:15.459589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79bfed-d6e1-48fe-845e-7bbe0ee99708 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:15.464520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52116-05f2-44f0-a92d-3ab07acf25d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:15.466312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52116-05f2-44f0-a92d-3ab07acf25d1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:15.467033 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52116-05f2-44f0-a92d-3ab07acf25d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:15.467662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52116-05f2-44f0-a92d-3ab07acf25d1 None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:15.470936 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d52116-05f2-44f0-a92d-3ab07acf25d1 None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.479623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d52116-05f2-44f0-a92d-3ab07acf25d1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:15.482664 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 46/92] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:15 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:15.484214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52116-05f2-44f0-a92d-3ab07acf25d1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:15.597138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79bfed-d6e1-48fe-845e-7bbe0ee99708 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:15.632019 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52116-05f2-44f0-a92d-3ab07acf25d1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:15.635399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:15.636121 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:15.636410 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:15.636706 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:15.637558 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c, user.id=1fec58596ab24b6da85e57a855ed085a) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:15.637864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.639347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:15.652821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 47/93] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:15 2022] GET /identity/v3/role_assignments?user.id=1fec58596ab24b6da85e57a855ed085a&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=52bf3a299728408b8384e30e08547fd8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:15.653853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:15.672809 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:15.673908 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:15.674532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:15.675042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:15.677034 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] RBAC: Adding query filter params (role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c, user.id=d312d466cfd04c698b6812ee7c7c1fdc) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:15.677721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.679500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:15.689475 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 47/94] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:15 2022] GET /identity/v3/role_assignments?user.id=d312d466cfd04c698b6812ee7c7c1fdc&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:15.781110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a9095-9f49-413b-9e6a-b0c3d4f88aa7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:15.834220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e565c-046d-4c3f-b6ce-99ffedb4f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:15.835834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e565c-046d-4c3f-b6ce-99ffedb4f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:15.836557 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e565c-046d-4c3f-b6ce-99ffedb4f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:15.837197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e565c-046d-4c3f-b6ce-99ffedb4f1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:15.931989 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e565c-046d-4c3f-b6ce-99ffedb4f1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:15.933900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e565c-046d-4c3f-b6ce-99ffedb4f1eb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:16.048439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 48/95] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:16.056706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:16.201389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465c1b-46b9-4c25-ba16-fd6beca5f892 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:16.240357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa236d-093e-47e7-a4a2-adc4e4313fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:16.241265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa236d-093e-47e7-a4a2-adc4e4313fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:16.241549 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa236d-093e-47e7-a4a2-adc4e4313fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:16.241828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa236d-093e-47e7-a4a2-adc4e4313fa8 None admin] PATH_INFO: `/v3/projects/3b838a465df34246a7cb874b18b986ee` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:16.243052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa236d-093e-47e7-a4a2-adc4e4313fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=3b838a465df34246a7cb874b18b986ee)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:16.244500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa236d-093e-47e7-a4a2-adc4e4313fa8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:16.246267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 48/96] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:16 2022] GET /identity/v3/projects/3b838a465df34246a7cb874b18b986ee => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:16.252121 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e565c-046d-4c3f-b6ce-99ffedb4f1eb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:16.388598 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e565c-046d-4c3f-b6ce-99ffedb4f1eb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:16.431344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1617b1-6e4f-4343-9b79-900a56b69286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:16.432406 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1617b1-6e4f-4343-9b79-900a56b69286 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:16.432933 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1617b1-6e4f-4343-9b79-900a56b69286 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:16.433424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1617b1-6e4f-4343-9b79-900a56b69286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:16.434485 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1617b1-6e4f-4343-9b79-900a56b69286 None admin] RBAC: Adding query filter params (role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=3b838a465df34246a7cb874b18b986ee, user.id=d312d466cfd04c698b6812ee7c7c1fdc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:16.435003 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1617b1-6e4f-4343-9b79-900a56b69286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:16.436658 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1617b1-6e4f-4343-9b79-900a56b69286 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:16.444773 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 49/97] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:16 2022] GET /identity/v3/role_assignments?user.id=d312d466cfd04c698b6812ee7c7c1fdc&scope.project.id=3b838a465df34246a7cb874b18b986ee&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:18.897850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85112a43-1785-4b0b-bd5b-860826122c8b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:18.898395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85112a43-1785-4b0b-bd5b-860826122c8b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:18.898831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85112a43-1785-4b0b-bd5b-860826122c8b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:18.901814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 49/98] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:18.907235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0331-113e-4e5c-9aee-21270ed9f1bb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:18.908057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0331-113e-4e5c-9aee-21270ed9f1bb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:18.908533 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0331-113e-4e5c-9aee-21270ed9f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:18.935242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f2ca0331-113e-4e5c-9aee-21270ed9f1bb None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:18.936801 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f2ca0331-113e-4e5c-9aee-21270ed9f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:19.033200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 50/99] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:19.078870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85112a43-1785-4b0b-bd5b-860826122c8b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:19.156949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9214-e04c-4dde-a659-47bdc43ebf72 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:19.157567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9214-e04c-4dde-a659-47bdc43ebf72 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:19.158047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9214-e04c-4dde-a659-47bdc43ebf72 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:19.160555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 51/100] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:19.166535 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ebb9a-769c-4757-bdba-5d31ad2f16e1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:19.167122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ebb9a-769c-4757-bdba-5d31ad2f16e1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:19.167602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ebb9a-769c-4757-bdba-5d31ad2f16e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:19.185818 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ec6ebb9a-769c-4757-bdba-5d31ad2f16e1 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:19.187359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ec6ebb9a-769c-4757-bdba-5d31ad2f16e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:19.263972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 52/101] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:19.288380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ebb9a-769c-4757-bdba-5d31ad2f16e1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:19.325647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85112a43-1785-4b0b-bd5b-860826122c8b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:19.409707 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8583b4-77b2-4ce0-b2ef-1e975dd2a566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:19.411002 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8583b4-77b2-4ce0-b2ef-1e975dd2a566 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:19.411289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8583b4-77b2-4ce0-b2ef-1e975dd2a566 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:19.411574 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8583b4-77b2-4ce0-b2ef-1e975dd2a566 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:19.444761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8583b4-77b2-4ce0-b2ef-1e975dd2a566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-cb8583b4-77b2-4ce0-b2ef-1e975dd2a566 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:19.453196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:19.454152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:19.454941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 50/102] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:58:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:19.463080 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8583b4-77b2-4ce0-b2ef-1e975dd2a566 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:19.651104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ebb9a-769c-4757-bdba-5d31ad2f16e1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:19.725444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8583b4-77b2-4ce0-b2ef-1e975dd2a566 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:19.785504 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fb33c-5f46-4410-8852-22e18d7e3bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:19.786352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb33c-5f46-4410-8852-22e18d7e3bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:19.786635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb33c-5f46-4410-8852-22e18d7e3bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:19.786911 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb33c-5f46-4410-8852-22e18d7e3bf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:19.809386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fb33c-5f46-4410-8852-22e18d7e3bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ff0fb33c-5f46-4410-8852-22e18d7e3bf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:19.818779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:19.819717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:19.820474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 53/103] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 532 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:19.826303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019b078-f890-450b-a853-618d98e0c034 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:19.827183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6fa03-3534-445d-bf59-e1ae9bf0bdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:19.827869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6fa03-3534-445d-bf59-e1ae9bf0bdbf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:19.828155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6fa03-3534-445d-bf59-e1ae9bf0bdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:19.828431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6fa03-3534-445d-bf59-e1ae9bf0bdbf None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:19.829254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6fa03-3534-445d-bf59-e1ae9bf0bdbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:19.829564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6fa03-3534-445d-bf59-e1ae9bf0bdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:19.831111 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6fa03-3534-445d-bf59-e1ae9bf0bdbf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:19.833780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019b078-f890-450b-a853-618d98e0c034 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:19.834049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019b078-f890-450b-a853-618d98e0c034 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:19.835704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 54/104] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:19 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:19.836282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019b078-f890-450b-a853-618d98e0c034 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:19.846806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 51/105] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:58:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:19.848205 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f26e8-2c00-4b2f-bfbc-8636878dd4bc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:19.848491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f26e8-2c00-4b2f-bfbc-8636878dd4bc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:19.848796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f26e8-2c00-4b2f-bfbc-8636878dd4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:19.883600 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8e6f26e8-2c00-4b2f-bfbc-8636878dd4bc None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:19.884837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8e6f26e8-2c00-4b2f-bfbc-8636878dd4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:20.008041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019b078-f890-450b-a853-618d98e0c034 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.008738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 52/106] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:20.017772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f26e8-2c00-4b2f-bfbc-8636878dd4bc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.061584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99420-17f3-4336-8733-bed131e2a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.062294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99420-17f3-4336-8733-bed131e2a37b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.062583 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99420-17f3-4336-8733-bed131e2a37b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.062861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99420-17f3-4336-8733-bed131e2a37b None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.063644 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99420-17f3-4336-8733-bed131e2a37b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:20.063950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99420-17f3-4336-8733-bed131e2a37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:20.065465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99420-17f3-4336-8733-bed131e2a37b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:20.080122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 55/107] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:20.087160 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded068ea-eaba-4c91-9ffb-6ebcca1b0f20 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.087677 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded068ea-eaba-4c91-9ffb-6ebcca1b0f20 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.088120 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded068ea-eaba-4c91-9ffb-6ebcca1b0f20 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.090349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 56/108] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:20.091251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded068ea-eaba-4c91-9ffb-6ebcca1b0f20 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.150833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f26e8-2c00-4b2f-bfbc-8636878dd4bc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.185871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14b465-4823-4f42-817a-23b44dac2a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.187018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14b465-4823-4f42-817a-23b44dac2a59 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.187452 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14b465-4823-4f42-817a-23b44dac2a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.187911 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14b465-4823-4f42-817a-23b44dac2a59 None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.189465 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14b465-4823-4f42-817a-23b44dac2a59 None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:20.191646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14b465-4823-4f42-817a-23b44dac2a59 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:20.194202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 53/109] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:20 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:20.195233 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14b465-4823-4f42-817a-23b44dac2a59 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.208169 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded068ea-eaba-4c91-9ffb-6ebcca1b0f20 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.245208 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f20fb8-8566-41ad-a97c-5a4b98121c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.246022 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f20fb8-8566-41ad-a97c-5a4b98121c6c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.246300 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f20fb8-8566-41ad-a97c-5a4b98121c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.246774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f20fb8-8566-41ad-a97c-5a4b98121c6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.248168 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f20fb8-8566-41ad-a97c-5a4b98121c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:20.249839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f20fb8-8566-41ad-a97c-5a4b98121c6c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:20.251670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 57/110] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:20.258211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a3a4-d51d-4f83-aff5-42b4f3d52dcd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.258425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a3a4-d51d-4f83-aff5-42b4f3d52dcd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.258706 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a3a4-d51d-4f83-aff5-42b4f3d52dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.275543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f154a3a4-d51d-4f83-aff5-42b4f3d52dcd None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:20.276743 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f154a3a4-d51d-4f83-aff5-42b4f3d52dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:20.304967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14b465-4823-4f42-817a-23b44dac2a59 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.339151 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658ed7d-5d4e-4f71-8922-85a010f56764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.340032 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ed7d-5d4e-4f71-8922-85a010f56764 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.340310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ed7d-5d4e-4f71-8922-85a010f56764 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.340583 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658ed7d-5d4e-4f71-8922-85a010f56764 None admin] PATH_INFO: `/v3/users/1fec58596ab24b6da85e57a855ed085a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.341888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658ed7d-5d4e-4f71-8922-85a010f56764 None admin] RBAC: Authorizing `identity:get_user(user_id=1fec58596ab24b6da85e57a855ed085a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:20.343489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658ed7d-5d4e-4f71-8922-85a010f56764 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:20.344929 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 58/111] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:20.351129 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 54/112] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:20 2022] GET /identity/v3/users/1fec58596ab24b6da85e57a855ed085a => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:20.351284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154a3a4-d51d-4f83-aff5-42b4f3d52dcd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.351357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182cd18-27ee-4cc4-abe4-2134345a8bd3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.351357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182cd18-27ee-4cc4-abe4-2134345a8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.351357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182cd18-27ee-4cc4-abe4-2134345a8bd3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.351357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 55/113] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:20.351357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182cd18-27ee-4cc4-abe4-2134345a8bd3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.451508 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154a3a4-d51d-4f83-aff5-42b4f3d52dcd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.457589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182cd18-27ee-4cc4-abe4-2134345a8bd3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.487337 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1a278-1589-4e27-8ce4-13e3ccf4ff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.488232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1a278-1589-4e27-8ce4-13e3ccf4ff3a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.488604 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1a278-1589-4e27-8ce4-13e3ccf4ff3a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.488799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1a278-1589-4e27-8ce4-13e3ccf4ff3a None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.490013 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1a278-1589-4e27-8ce4-13e3ccf4ff3a None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:20.491487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1a278-1589-4e27-8ce4-13e3ccf4ff3a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:20.493458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 59/114] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:20 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:20.494468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67647a92-33f5-4482-8106-838a7ed79663 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.494758 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67647a92-33f5-4482-8106-838a7ed79663 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.495025 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67647a92-33f5-4482-8106-838a7ed79663 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.496039 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c742e08-a2af-4112-83f3-5b6ddd3586b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.496267 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 60/115] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:20.496985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67647a92-33f5-4482-8106-838a7ed79663 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.497089 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c742e08-a2af-4112-83f3-5b6ddd3586b3 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.497372 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c742e08-a2af-4112-83f3-5b6ddd3586b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.497647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c742e08-a2af-4112-83f3-5b6ddd3586b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.498402 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c742e08-a2af-4112-83f3-5b6ddd3586b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:20.499841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c742e08-a2af-4112-83f3-5b6ddd3586b3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:20.527971 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 56/116] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 13:58:20 2022] POST /identity/v3/projects => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:20.529208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda113-ac6c-45e7-8b2f-7189e224d4cd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.529506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda113-ac6c-45e7-8b2f-7189e224d4cd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.529788 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda113-ac6c-45e7-8b2f-7189e224d4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.549373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3beda113-ac6c-45e7-8b2f-7189e224d4cd None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:20.551957 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3beda113-ac6c-45e7-8b2f-7189e224d4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:20.623261 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67647a92-33f5-4482-8106-838a7ed79663 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.631042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 57/117] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:20.633740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda113-ac6c-45e7-8b2f-7189e224d4cd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.669257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea8116-64f4-4f1e-9bf7-7a9d10cac0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.670149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8116-64f4-4f1e-9bf7-7a9d10cac0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.670430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8116-64f4-4f1e-9bf7-7a9d10cac0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.670708 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8116-64f4-4f1e-9bf7-7a9d10cac0b3 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.672014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea8116-64f4-4f1e-9bf7-7a9d10cac0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:20.673743 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea8116-64f4-4f1e-9bf7-7a9d10cac0b3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:20.675547 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 61/118] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:20 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:20.682197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f156db-0382-48bd-9f49-75c0e897d34a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.682197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f156db-0382-48bd-9f49-75c0e897d34a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.682197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f156db-0382-48bd-9f49-75c0e897d34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.698432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c7f156db-0382-48bd-9f49-75c0e897d34a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:20.699646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c7f156db-0382-48bd-9f49-75c0e897d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:20.756587 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda113-ac6c-45e7-8b2f-7189e224d4cd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.779643 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 62/119] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:20.780087 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f156db-0382-48bd-9f49-75c0e897d34a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.802190 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cbf48-f94a-401f-93e9-ba49ab3cdfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.803007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cbf48-f94a-401f-93e9-ba49ab3cdfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.803290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cbf48-f94a-401f-93e9-ba49ab3cdfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.803571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cbf48-f94a-401f-93e9-ba49ab3cdfe8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.814588 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cbf48-f94a-401f-93e9-ba49ab3cdfe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-341cbf48-f94a-401f-93e9-ba49ab3cdfe8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:20.823300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:20.824327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 58/120] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:20.825784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cbf48-f94a-401f-93e9-ba49ab3cdfe8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.895212 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f156db-0382-48bd-9f49-75c0e897d34a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.931944 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24205a31-a88c-49e5-b91a-d8e848550f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.932876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24205a31-a88c-49e5-b91a-d8e848550f66 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.933184 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24205a31-a88c-49e5-b91a-d8e848550f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.933460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24205a31-a88c-49e5-b91a-d8e848550f66 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/users/d312d466cfd04c698b6812ee7c7c1fdc/roles/b38b04aec27e41b9a8c2824918eedd12` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:20.935770 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24205a31-a88c-49e5-b91a-d8e848550f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b0c2761cb4387b2427fcd3c01356c, user_id=d312d466cfd04c698b6812ee7c7c1fdc, role_id=b38b04aec27e41b9a8c2824918eedd12)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:20.937277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24205a31-a88c-49e5-b91a-d8e848550f66 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:20.941943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cbf48-f94a-401f-93e9-ba49ab3cdfe8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:20.953494 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 63/121] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:20 2022] PUT /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/users/d312d466cfd04c698b6812ee7c7c1fdc/roles/b38b04aec27e41b9a8c2824918eedd12 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:20.954016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24205a31-a88c-49e5-b91a-d8e848550f66 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:20.986063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d24401-186c-49a6-b279-08cf61117886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:20.986989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24401-186c-49a6-b279-08cf61117886 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:20.987219 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24401-186c-49a6-b279-08cf61117886 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:20.987500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24401-186c-49a6-b279-08cf61117886 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.001552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d24401-186c-49a6-b279-08cf61117886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d6d24401-186c-49a6-b279-08cf61117886 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:21.010847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:21.018307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 59/122] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:21.019663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d24401-186c-49a6-b279-08cf61117886 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:21.098572 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24205a31-a88c-49e5-b91a-d8e848550f66 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:21.135103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d24401-186c-49a6-b279-08cf61117886 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:21.139468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c175ba-5808-4a73-96b4-9325cdc986c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:21.140867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c175ba-5808-4a73-96b4-9325cdc986c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:21.141387 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c175ba-5808-4a73-96b4-9325cdc986c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:21.141914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c175ba-5808-4a73-96b4-9325cdc986c3 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/users/1fec58596ab24b6da85e57a855ed085a/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.145243 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c175ba-5808-4a73-96b4-9325cdc986c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b0c2761cb4387b2427fcd3c01356c, user_id=1fec58596ab24b6da85e57a855ed085a, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:21.147027 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c175ba-5808-4a73-96b4-9325cdc986c3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:21.168926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 64/123] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:20 2022] PUT /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/users/1fec58596ab24b6da85e57a855ed085a/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:21.170176 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c175ba-5808-4a73-96b4-9325cdc986c3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:21.182274 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e640-c40e-41a5-99bf-b1fa13f48586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:21.182622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e640-c40e-41a5-99bf-b1fa13f48586 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:21.182932 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e640-c40e-41a5-99bf-b1fa13f48586 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:21.183216 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e640-c40e-41a5-99bf-b1fa13f48586 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.197052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9e640-c40e-41a5-99bf-b1fa13f48586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b7f9e640-c40e-41a5-99bf-b1fa13f48586 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:21.205806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:21.207379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:21.208170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:21.208765 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 60/124] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:21.209477 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e640-c40e-41a5-99bf-b1fa13f48586 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:21.341629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c175ba-5808-4a73-96b4-9325cdc986c3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:21.407180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e640-c40e-41a5-99bf-b1fa13f48586 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:21.407590 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:21.408279 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:21.408764 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:21.409097 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.410849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:21.411384 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:21.412843 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:21.423665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 65/125] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:21.424530 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:21.465556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:21.466563 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:21.466993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:21.467410 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.468621 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:21.470379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:21.472658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:21.484848 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 61/126] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:21.485823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:21.599982 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfa98b-408f-4283-a4e3-9005912a0cfa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:21.606134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdb18d-8a4b-4ee2-9445-1737bdf8f5dc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:21.651952 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee940a-eba0-432e-8d59-bf62b8929193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:21.652899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee940a-eba0-432e-8d59-bf62b8929193 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:21.653187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee940a-eba0-432e-8d59-bf62b8929193 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:21.653468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee940a-eba0-432e-8d59-bf62b8929193 None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.654812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee940a-eba0-432e-8d59-bf62b8929193 None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:21.656317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee940a-eba0-432e-8d59-bf62b8929193 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:21.658600 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 62/127] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:21 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:21.659403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee940a-eba0-432e-8d59-bf62b8929193 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:21.674588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:21.674588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:21.674588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:21.674588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.674983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:21.674983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:21.674983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:21.697628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 66/128] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:21.698531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:21.887942 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee940a-eba0-432e-8d59-bf62b8929193 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:21.920545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb4c1-7899-4422-8db3-eff9aafa6889 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:21.961304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a5fd-a87a-42ec-8010-eea70070396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:21.962213 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a5fd-a87a-42ec-8010-eea70070396d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:21.962501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a5fd-a87a-42ec-8010-eea70070396d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:21.962782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a5fd-a87a-42ec-8010-eea70070396d None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.964319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58a5fd-a87a-42ec-8010-eea70070396d None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:21.965462 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6892250-efdd-40b9-bd61-b7a76b5abf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:21.966035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58a5fd-a87a-42ec-8010-eea70070396d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:21.966383 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6892250-efdd-40b9-bd61-b7a76b5abf74 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:21.966757 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6892250-efdd-40b9-bd61-b7a76b5abf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:21.967041 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6892250-efdd-40b9-bd61-b7a76b5abf74 None admin] PATH_INFO: `/v3/users/bee70c4330614497ade564790e71c24c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:21.968023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 67/129] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:21 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:21.973480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a5fd-a87a-42ec-8010-eea70070396d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:22.009500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6892250-efdd-40b9-bd61-b7a76b5abf74 None admin] RBAC: Authorizing `identity:get_user(user_id=bee70c4330614497ade564790e71c24c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:22.011008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6892250-efdd-40b9-bd61-b7a76b5abf74 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:22.013008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 63/130] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:21 2022] GET /identity/v3/users/bee70c4330614497ade564790e71c24c => generated 289 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:22.013701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6892250-efdd-40b9-bd61-b7a76b5abf74 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:22.086100 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a5fd-a87a-42ec-8010-eea70070396d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:22.124790 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ded3c-3912-4f70-b70b-6f91a42233d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:22.125908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ded3c-3912-4f70-b70b-6f91a42233d8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:22.126199 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ded3c-3912-4f70-b70b-6f91a42233d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:22.126481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ded3c-3912-4f70-b70b-6f91a42233d8 None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:22.128007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ded3c-3912-4f70-b70b-6f91a42233d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:22.130723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ded3c-3912-4f70-b70b-6f91a42233d8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:22.133063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 68/131] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:21 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:22.133868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ded3c-3912-4f70-b70b-6f91a42233d8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:22.211855 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6892250-efdd-40b9-bd61-b7a76b5abf74 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:22.290282 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69f5f-b47a-451c-b016-6891256c75cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:22.291589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69f5f-b47a-451c-b016-6891256c75cd None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:22.292079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69f5f-b47a-451c-b016-6891256c75cd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:22.292550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69f5f-b47a-451c-b016-6891256c75cd None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/users/d312d466cfd04c698b6812ee7c7c1fdc/roles/8e27b8e86fc845e9b8569e559e21603f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:22.294852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae69f5f-b47a-451c-b016-6891256c75cd None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b0c2761cb4387b2427fcd3c01356c, user_id=d312d466cfd04c698b6812ee7c7c1fdc, role_id=8e27b8e86fc845e9b8569e559e21603f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:22.296554 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae69f5f-b47a-451c-b016-6891256c75cd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:22.308700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ded3c-3912-4f70-b70b-6f91a42233d8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:22.331199 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 64/132] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:22 2022] PUT /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/users/d312d466cfd04c698b6812ee7c7c1fdc/roles/8e27b8e86fc845e9b8569e559e21603f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:22.333022 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69f5f-b47a-451c-b016-6891256c75cd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:22.342157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15812ac-e3f9-4803-8072-14d95ca4c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:22.342894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15812ac-e3f9-4803-8072-14d95ca4c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:22.343185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15812ac-e3f9-4803-8072-14d95ca4c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:22.343513 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15812ac-e3f9-4803-8072-14d95ca4c1d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:22.423704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15812ac-e3f9-4803-8072-14d95ca4c1d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:22.425247 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15812ac-e3f9-4803-8072-14d95ca4c1d1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:22.497025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69f5f-b47a-451c-b016-6891256c75cd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:22.537752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c4f94-96ac-4664-8195-64949fbf6a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:22.538643 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c4f94-96ac-4664-8195-64949fbf6a34 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:22.538931 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c4f94-96ac-4664-8195-64949fbf6a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:22.539310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c4f94-96ac-4664-8195-64949fbf6a34 None admin] PATH_INFO: `/v3/projects/3b838a465df34246a7cb874b18b986ee` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:22.541092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c4f94-96ac-4664-8195-64949fbf6a34 None admin] RBAC: Authorizing `identity:get_project(project_id=3b838a465df34246a7cb874b18b986ee)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:22.543060 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c4f94-96ac-4664-8195-64949fbf6a34 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:22.545883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 65/133] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:22 2022] GET /identity/v3/projects/3b838a465df34246a7cb874b18b986ee => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:22.546419 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 69/134] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:22.553254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c4f94-96ac-4664-8195-64949fbf6a34 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:22.555613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15812ac-e3f9-4803-8072-14d95ca4c1d1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:22.670047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c4f94-96ac-4664-8195-64949fbf6a34 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:22.710596 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df363f-be87-4691-b3c7-9765ec4e933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:22.711491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df363f-be87-4691-b3c7-9765ec4e933c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:22.711777 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df363f-be87-4691-b3c7-9765ec4e933c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:22.712116 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df363f-be87-4691-b3c7-9765ec4e933c None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:22.713495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df363f-be87-4691-b3c7-9765ec4e933c None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:22.714991 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df363f-be87-4691-b3c7-9765ec4e933c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:22.717225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 66/135] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:22 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:22.732209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df363f-be87-4691-b3c7-9765ec4e933c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:22.732595 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15812ac-e3f9-4803-8072-14d95ca4c1d1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:22.821984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94379647-a8f6-4869-bfdf-5904ace398f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:22.822901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379647-a8f6-4869-bfdf-5904ace398f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:22.823187 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379647-a8f6-4869-bfdf-5904ace398f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:22.823465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379647-a8f6-4869-bfdf-5904ace398f2 None admin] PATH_INFO: `/v3/projects/3b838a465df34246a7cb874b18b986ee/users/d312d466cfd04c698b6812ee7c7c1fdc/roles/8e27b8e86fc845e9b8569e559e21603f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:22.830392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94379647-a8f6-4869-bfdf-5904ace398f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b838a465df34246a7cb874b18b986ee, user_id=d312d466cfd04c698b6812ee7c7c1fdc, role_id=8e27b8e86fc845e9b8569e559e21603f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:22.831901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94379647-a8f6-4869-bfdf-5904ace398f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:22.858240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 70/136] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:22 2022] PUT /identity/v3/projects/3b838a465df34246a7cb874b18b986ee/users/d312d466cfd04c698b6812ee7c7c1fdc/roles/8e27b8e86fc845e9b8569e559e21603f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 13:58:22.887497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df363f-be87-4691-b3c7-9765ec4e933c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:22.929155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994372c1-56b5-4c5f-a9ba-6ce6fdc4f134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:22.929837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994372c1-56b5-4c5f-a9ba-6ce6fdc4f134 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:22.930178 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994372c1-56b5-4c5f-a9ba-6ce6fdc4f134 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:22.930461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994372c1-56b5-4c5f-a9ba-6ce6fdc4f134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:22.931321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994372c1-56b5-4c5f-a9ba-6ce6fdc4f134 None admin] RBAC: Adding query filter params (role.id=2cb369a212074a9aae140dfa2d236368, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c, user.id=bee70c4330614497ade564790e71c24c) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:22.931640 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994372c1-56b5-4c5f-a9ba-6ce6fdc4f134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:22.933200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994372c1-56b5-4c5f-a9ba-6ce6fdc4f134 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:22.941645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 67/137] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:22 2022] GET /identity/v3/role_assignments?user.id=bee70c4330614497ade564790e71c24c&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=2cb369a212074a9aae140dfa2d236368 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:23.722300 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31125e-9064-4a5f-a500-ab6ab2260250 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:23.722810 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31125e-9064-4a5f-a500-ab6ab2260250 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:23.723122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31125e-9064-4a5f-a500-ab6ab2260250 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:23.724633 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 71/138] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:23.730344 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbf608-36a1-4f63-af5e-494cb5d9d690 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:23.730789 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbf608-36a1-4f63-af5e-494cb5d9d690 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:23.730984 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbf608-36a1-4f63-af5e-494cb5d9d690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:23.754272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-69fbf608-36a1-4f63-af5e-494cb5d9d690 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:23.755877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-69fbf608-36a1-4f63-af5e-494cb5d9d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:23.846727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 68/139] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:23.872524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31125e-9064-4a5f-a500-ab6ab2260250 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:24.028846 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31125e-9064-4a5f-a500-ab6ab2260250 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:24.071125 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b617e84-1604-4963-837e-610451a126f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:24.071922 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617e84-1604-4963-837e-610451a126f6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:24.072202 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617e84-1604-4963-837e-610451a126f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:24.072473 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b617e84-1604-4963-837e-610451a126f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:24.077433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b617e84-1604-4963-837e-610451a126f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:24.078965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b617e84-1604-4963-837e-610451a126f6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:24.081234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 72/140] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:24.094755 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbf608-36a1-4f63-af5e-494cb5d9d690 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:24.230201 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8f37-0996-4793-8176-f4c0b553a265 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:24.230475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8f37-0996-4793-8176-f4c0b553a265 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:24.230822 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8f37-0996-4793-8176-f4c0b553a265 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:24.232552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 73/141] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:24.238937 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7860-a44a-4cd8-a581-5066b6662d3f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:24.239272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7860-a44a-4cd8-a581-5066b6662d3f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:24.239562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7860-a44a-4cd8-a581-5066b6662d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:24.284972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c6be7860-a44a-4cd8-a581-5066b6662d3f None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:24.284972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c6be7860-a44a-4cd8-a581-5066b6662d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:24.350672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbf608-36a1-4f63-af5e-494cb5d9d690 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:24.430020 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de6e85-1411-460e-94ff-4f225eb7a370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:24.431821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6e85-1411-460e-94ff-4f225eb7a370 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:24.432633 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6e85-1411-460e-94ff-4f225eb7a370 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:24.433620 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6e85-1411-460e-94ff-4f225eb7a370 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:24.435529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de6e85-1411-460e-94ff-4f225eb7a370 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:24.439447 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de6e85-1411-460e-94ff-4f225eb7a370 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:24.456258 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 74/142] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:24.493186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 69/143] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:58:24 2022] POST /identity/v3/users => generated 283 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:24.504045 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be7860-a44a-4cd8-a581-5066b6662d3f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:24.563570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92173d95-1f5e-4ccb-b9cc-91e70a6fa1f2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:24.564557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92173d95-1f5e-4ccb-b9cc-91e70a6fa1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:24.565405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92173d95-1f5e-4ccb-b9cc-91e70a6fa1f2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:24.569406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 70/144] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:24.576408 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffd1f6-9cbc-47ff-a36a-e6444819ab98 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:24.577354 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffd1f6-9cbc-47ff-a36a-e6444819ab98 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:24.578176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffd1f6-9cbc-47ff-a36a-e6444819ab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:24.626782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c8ffd1f6-9cbc-47ff-a36a-e6444819ab98 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:24.637742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c8ffd1f6-9cbc-47ff-a36a-e6444819ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:24.646540 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be7860-a44a-4cd8-a581-5066b6662d3f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:24.695274 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f407-de70-4fb2-9b0f-ee98a9546793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:24.696114 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f407-de70-4fb2-9b0f-ee98a9546793 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:24.696391 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f407-de70-4fb2-9b0f-ee98a9546793 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:24.696655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f407-de70-4fb2-9b0f-ee98a9546793 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:24.726371 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220f407-de70-4fb2-9b0f-ee98a9546793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b220f407-de70-4fb2-9b0f-ee98a9546793 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:24.741225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:24.742853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:24.746029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 75/145] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:58:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:24.748993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f407-de70-4fb2-9b0f-ee98a9546793 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:24.836587 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 71/146] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:24.870185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffd1f6-9cbc-47ff-a36a-e6444819ab98 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:24.983109 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f407-de70-4fb2-9b0f-ee98a9546793 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:25.058929 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffd1f6-9cbc-47ff-a36a-e6444819ab98 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:25.061430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:25.062127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:25.062411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:25.062678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:25.063449 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:25.063756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:25.066448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:25.079734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 76/147] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:58:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:25.085488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:25.140080 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f915ff-73b4-4a31-aa5a-0456ddc3e160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:25.141934 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f915ff-73b4-4a31-aa5a-0456ddc3e160 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:25.144099 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f915ff-73b4-4a31-aa5a-0456ddc3e160 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:25.146719 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f915ff-73b4-4a31-aa5a-0456ddc3e160 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:25.181278 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f915ff-73b4-4a31-aa5a-0456ddc3e160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-37f915ff-73b4-4a31-aa5a-0456ddc3e160 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:25.211144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:25.212914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:25.214266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:25.221862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 72/148] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:25.234106 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f915ff-73b4-4a31-aa5a-0456ddc3e160 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:25.431678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547163e-8b7d-4a61-8f1d-546a6bd8c092 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:25.544820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f915ff-73b4-4a31-aa5a-0456ddc3e160 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:25.546023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60032cf9-9f1a-4d90-8689-5bedba92a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:25.547799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032cf9-9f1a-4d90-8689-5bedba92a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:25.548535 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032cf9-9f1a-4d90-8689-5bedba92a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:25.549379 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032cf9-9f1a-4d90-8689-5bedba92a3e6 None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:25.554470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60032cf9-9f1a-4d90-8689-5bedba92a3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:25.557578 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60032cf9-9f1a-4d90-8689-5bedba92a3e6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:25.561836 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 77/149] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:25 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:25.569434 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60032cf9-9f1a-4d90-8689-5bedba92a3e6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:25.618501 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:25.619207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:25.619486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:25.619759 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:25.620535 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:25.620879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:25.622321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:25.635610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 73/150] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:25.643951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:25.781177 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60032cf9-9f1a-4d90-8689-5bedba92a3e6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:25.793441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbcee9-dcb0-4a54-8f2b-b38f35b77d1c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:25.844108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a77293-c499-4e22-bbc9-bd2999380890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:25.845249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77293-c499-4e22-bbc9-bd2999380890 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:25.845478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77293-c499-4e22-bbc9-bd2999380890 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:25.845720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77293-c499-4e22-bbc9-bd2999380890 None admin] PATH_INFO: `/v3/users/1fec58596ab24b6da85e57a855ed085a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:25.846999 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a77293-c499-4e22-bbc9-bd2999380890 None admin] RBAC: Authorizing `identity:get_user(user_id=1fec58596ab24b6da85e57a855ed085a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:25.848538 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a77293-c499-4e22-bbc9-bd2999380890 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:25.850241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 74/151] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:25 2022] GET /identity/v3/users/1fec58596ab24b6da85e57a855ed085a => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:25.858615 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a77293-c499-4e22-bbc9-bd2999380890 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:25.861017 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3014c-b44e-4a3b-8b41-93d1db7d2ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:25.861696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3014c-b44e-4a3b-8b41-93d1db7d2ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:25.861969 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3014c-b44e-4a3b-8b41-93d1db7d2ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:25.862226 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3014c-b44e-4a3b-8b41-93d1db7d2ad2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:25.971591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a77293-c499-4e22-bbc9-bd2999380890 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:25.993927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3014c-b44e-4a3b-8b41-93d1db7d2ad2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:25.995411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3014c-b44e-4a3b-8b41-93d1db7d2ad2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:26.036088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea755be-093d-42e6-bf98-1b7676baa1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:26.036660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea755be-093d-42e6-bf98-1b7676baa1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:26.037349 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea755be-093d-42e6-bf98-1b7676baa1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:26.037349 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea755be-093d-42e6-bf98-1b7676baa1b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:26.185722 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 78/152] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:26.192278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3014c-b44e-4a3b-8b41-93d1db7d2ad2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:26.208769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea755be-093d-42e6-bf98-1b7676baa1b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:26.210247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea755be-093d-42e6-bf98-1b7676baa1b1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:26.340062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3014c-b44e-4a3b-8b41-93d1db7d2ad2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:26.380085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caa5b8-cbd3-4827-9f6b-8db0f8849051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:26.380983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caa5b8-cbd3-4827-9f6b-8db0f8849051 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:26.381266 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caa5b8-cbd3-4827-9f6b-8db0f8849051 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:26.381541 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caa5b8-cbd3-4827-9f6b-8db0f8849051 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:26.385437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4caa5b8-cbd3-4827-9f6b-8db0f8849051 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:26.386907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4caa5b8-cbd3-4827-9f6b-8db0f8849051 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:26.388989 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 79/153] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:26 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:26.390378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16de110-df1c-489f-9683-8c9f770a30c0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:26.390662 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16de110-df1c-489f-9683-8c9f770a30c0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:26.390955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16de110-df1c-489f-9683-8c9f770a30c0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:26.396702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 80/154] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:26.396702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16de110-df1c-489f-9683-8c9f770a30c0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:26.418857 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 75/155] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 13:58:26.420724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561ff04-e799-44b4-b551-2cb73502f64d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:26.421256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561ff04-e799-44b4-b551-2cb73502f64d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:26.421764 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561ff04-e799-44b4-b551-2cb73502f64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:26.439131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0561ff04-e799-44b4-b551-2cb73502f64d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:26.440659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0561ff04-e799-44b4-b551-2cb73502f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:26.520787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 76/156] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:26.522082 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561ff04-e799-44b4-b551-2cb73502f64d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:26.542535 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16de110-df1c-489f-9683-8c9f770a30c0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:26.602292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:26.602937 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:26.603313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:26.603479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:26.604341 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] RBAC: Adding query filter params (role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c, user.id=d312d466cfd04c698b6812ee7c7c1fdc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:26.607833 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:26.607833 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:26.617771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 81/157] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:26 2022] GET /identity/v3/role_assignments?user.id=d312d466cfd04c698b6812ee7c7c1fdc&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:26.618823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:26.654875 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561ff04-e799-44b4-b551-2cb73502f64d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:26.694107 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b576d-a290-4c86-8ccd-8ff052838c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:26.695379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b576d-a290-4c86-8ccd-8ff052838c27 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:26.695869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b576d-a290-4c86-8ccd-8ff052838c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:26.696341 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b576d-a290-4c86-8ccd-8ff052838c27 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:26.697946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b576d-a290-4c86-8ccd-8ff052838c27 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:26.699681 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b576d-a290-4c86-8ccd-8ff052838c27 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:26.701808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 77/158] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:26 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:26.709985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b576d-a290-4c86-8ccd-8ff052838c27 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:26.777159 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab88a87-b81a-4fb7-bc1f-97aaf88e07bb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:26.834631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202082f-9f7c-48f1-9dee-ef13518232f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:26.835453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202082f-9f7c-48f1-9dee-ef13518232f6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:26.835730 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202082f-9f7c-48f1-9dee-ef13518232f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:26.836154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202082f-9f7c-48f1-9dee-ef13518232f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:26.847414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b576d-a290-4c86-8ccd-8ff052838c27 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:26.858675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202082f-9f7c-48f1-9dee-ef13518232f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d202082f-9f7c-48f1-9dee-ef13518232f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:26.871071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:26.871981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:26.872751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:26.875185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 82/159] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:26.881825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202082f-9f7c-48f1-9dee-ef13518232f6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:26.887087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:26.888136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:26.888613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:26.889068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:26.890108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c, user.id=1fec58596ab24b6da85e57a855ed085a) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:26.890564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:26.892201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:26.899494 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 78/160] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:26 2022] GET /identity/v3/role_assignments?user.id=1fec58596ab24b6da85e57a855ed085a&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=52bf3a299728408b8384e30e08547fd8 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:27.001894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202082f-9f7c-48f1-9dee-ef13518232f6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:27.048292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:27.049016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:27.049296 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:27.049567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:27.050915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:27.051251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:27.052704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:27.062262 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 83/161] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:27.073897 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:27.230231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc9bd-5f35-40a2-bb85-6960b6ffcdc7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:27.293747 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc609743-f646-45c9-a556-35d7e1b7a42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:27.294671 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609743-f646-45c9-a556-35d7e1b7a42e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:27.294945 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609743-f646-45c9-a556-35d7e1b7a42e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:27.295217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609743-f646-45c9-a556-35d7e1b7a42e None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:27.296661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc609743-f646-45c9-a556-35d7e1b7a42e None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:27.298204 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc609743-f646-45c9-a556-35d7e1b7a42e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:27.299914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 79/162] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:27 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:27.307165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:27.447427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d0dc-3e70-4866-9aa8-ee34118b8059 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:27.488770 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31940269-f621-4b84-ad8f-cffbf586ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:27.489432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31940269-f621-4b84-ad8f-cffbf586ef70 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:27.489726 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31940269-f621-4b84-ad8f-cffbf586ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:27.490018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31940269-f621-4b84-ad8f-cffbf586ef70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:27.576594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31940269-f621-4b84-ad8f-cffbf586ef70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:27.578100 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31940269-f621-4b84-ad8f-cffbf586ef70 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:27.682797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 84/163] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:27.690801 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc609743-f646-45c9-a556-35d7e1b7a42e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:27.800153 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007fa68-98ae-4958-afcc-dde85770cf8d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:27.801161 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007fa68-98ae-4958-afcc-dde85770cf8d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:27.801359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007fa68-98ae-4958-afcc-dde85770cf8d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:27.802819 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 85/164] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:27.816876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593b68-5ffc-4aab-9fe5-a645e8a0e360 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:27.817249 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593b68-5ffc-4aab-9fe5-a645e8a0e360 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:27.817457 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593b68-5ffc-4aab-9fe5-a645e8a0e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:27.853748 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f8593b68-5ffc-4aab-9fe5-a645e8a0e360 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:27.854947 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f8593b68-5ffc-4aab-9fe5-a645e8a0e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:27.889087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc609743-f646-45c9-a556-35d7e1b7a42e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:27.968779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 86/165] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:27.971343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e126-70b9-47da-9066-e74aee6a15c2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:27.974221 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e126-70b9-47da-9066-e74aee6a15c2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:27.975924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e126-70b9-47da-9066-e74aee6a15c2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:27.978314 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 87/166] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:27.986142 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82c61-5596-4828-a9c1-da13b6d4228a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:27.986881 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82c61-5596-4828-a9c1-da13b6d4228a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:27.990246 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82c61-5596-4828-a9c1-da13b6d4228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:28.014935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b789-13c4-4719-9a6c-cba83361b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:28.017015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b789-13c4-4719-9a6c-cba83361b40c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:28.017787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b789-13c4-4719-9a6c-cba83361b40c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:28.018554 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b789-13c4-4719-9a6c-cba83361b40c None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:28.024770 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908b789-13c4-4719-9a6c-cba83361b40c None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:28.027991 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908b789-13c4-4719-9a6c-cba83361b40c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:28.031749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 80/167] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:27 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:28.041818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b789-13c4-4719-9a6c-cba83361b40c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:28.043816 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-44b82c61-5596-4828-a9c1-da13b6d4228a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:28.046833 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-44b82c61-5596-4828-a9c1-da13b6d4228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:28.239660 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 88/168] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:28.240432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82c61-5596-4828-a9c1-da13b6d4228a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:28.299275 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b789-13c4-4719-9a6c-cba83361b40c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:28.375546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503d6f-c52c-44f3-a5aa-211819743bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:28.377525 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503d6f-c52c-44f3-a5aa-211819743bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:28.380146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503d6f-c52c-44f3-a5aa-211819743bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:28.381069 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503d6f-c52c-44f3-a5aa-211819743bb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:28.429348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13503d6f-c52c-44f3-a5aa-211819743bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-13503d6f-c52c-44f3-a5aa-211819743bb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:28.437056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:28.438677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 81/169] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:28.440206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503d6f-c52c-44f3-a5aa-211819743bb3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:28.491265 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82c61-5596-4828-a9c1-da13b6d4228a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:28.556467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:28.557161 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:28.557428 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:28.557700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:28.558610 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] RBAC: Adding query filter params (role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c, user.id=d312d466cfd04c698b6812ee7c7c1fdc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:28.558904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:28.560365 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:28.572988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 89/170] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:28 2022] GET /identity/v3/role_assignments?user.id=d312d466cfd04c698b6812ee7c7c1fdc&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:28.573568 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:28.649334 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503d6f-c52c-44f3-a5aa-211819743bb3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:28.716477 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b10c6-5c8c-4b1a-a6b8-37e9529bbca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:28.717325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b10c6-5c8c-4b1a-a6b8-37e9529bbca5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:28.717613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b10c6-5c8c-4b1a-a6b8-37e9529bbca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:28.717868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b10c6-5c8c-4b1a-a6b8-37e9529bbca5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:28.739390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b10c6-5c8c-4b1a-a6b8-37e9529bbca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:28.749900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85fb80-1d22-4624-9646-cb0a427d33ca None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a26b10c6-5c8c-4b1a-a6b8-37e9529bbca5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:28.757075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:28.760177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:28.761749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 82/171] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:28.772332 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b10c6-5c8c-4b1a-a6b8-37e9529bbca5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:28.794217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:28.794904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:28.795171 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:28.795427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:28.796200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:28.796502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:28.797933 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:28.808078 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 90/172] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:28.817967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:28.932152 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429afd6-140e-4c11-9728-cda4a555b945 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:28.938472 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b10c6-5c8c-4b1a-a6b8-37e9529bbca5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:28.968144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fe09-a399-4a06-9f8d-7282bd49c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:28.969397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fe09-a399-4a06-9f8d-7282bd49c31e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:28.969862 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fe09-a399-4a06-9f8d-7282bd49c31e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:28.970316 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fe09-a399-4a06-9f8d-7282bd49c31e None admin] PATH_INFO: `/v3/users/d312d466cfd04c698b6812ee7c7c1fdc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:28.972035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37fe09-a399-4a06-9f8d-7282bd49c31e None admin] RBAC: Authorizing `identity:get_user(user_id=d312d466cfd04c698b6812ee7c7c1fdc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:28.974530 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37fe09-a399-4a06-9f8d-7282bd49c31e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:28.976430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 91/173] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:28 2022] GET /identity/v3/users/d312d466cfd04c698b6812ee7c7c1fdc => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:28.985731 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fe09-a399-4a06-9f8d-7282bd49c31e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:29.013874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:29.014928 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.015413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.016084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.017671 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:29.018377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:29.021877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:29.050065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 83/174] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:29.071959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:29.102554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fe09-a399-4a06-9f8d-7282bd49c31e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:29.138394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73951241-7573-42f7-994b-eae9996ed8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:29.139285 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951241-7573-42f7-994b-eae9996ed8ff None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.139813 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951241-7573-42f7-994b-eae9996ed8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.140230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951241-7573-42f7-994b-eae9996ed8ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.212831 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73951241-7573-42f7-994b-eae9996ed8ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:29.214658 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73951241-7573-42f7-994b-eae9996ed8ff None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:29.323230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 92/175] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:29.329090 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73951241-7573-42f7-994b-eae9996ed8ff None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:29.336119 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d37a-ad2b-4fa9-a100-5774fedba5d7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:29.418862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4620e6-18b5-4d47-8207-5c45716c25ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:29.420474 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4620e6-18b5-4d47-8207-5c45716c25ca None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.421258 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4620e6-18b5-4d47-8207-5c45716c25ca None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.421993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4620e6-18b5-4d47-8207-5c45716c25ca None admin] PATH_INFO: `/v3/users/bee70c4330614497ade564790e71c24c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.430118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4620e6-18b5-4d47-8207-5c45716c25ca None admin] RBAC: Authorizing `identity:get_user(user_id=bee70c4330614497ade564790e71c24c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:29.433353 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4620e6-18b5-4d47-8207-5c45716c25ca None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:29.435726 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73951241-7573-42f7-994b-eae9996ed8ff None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:29.436914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 84/176] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:29 2022] GET /identity/v3/users/bee70c4330614497ade564790e71c24c => generated 289 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:29.444547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20948ac-58b1-4067-8654-25ab0c43f9ad None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.445094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20948ac-58b1-4067-8654-25ab0c43f9ad None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.445579 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20948ac-58b1-4067-8654-25ab0c43f9ad None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.448109 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 85/177] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:29.449662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20948ac-58b1-4067-8654-25ab0c43f9ad None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:29.480213 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdf8e0-a2a0-43cd-87f9-6e7396b2b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:29.481158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf8e0-a2a0-43cd-87f9-6e7396b2b99f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.481440 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf8e0-a2a0-43cd-87f9-6e7396b2b99f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.481749 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf8e0-a2a0-43cd-87f9-6e7396b2b99f None admin] PATH_INFO: `/v3/projects/3b838a465df34246a7cb874b18b986ee` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.483080 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdf8e0-a2a0-43cd-87f9-6e7396b2b99f None admin] RBAC: Authorizing `identity:get_project(project_id=3b838a465df34246a7cb874b18b986ee)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:29.484579 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdf8e0-a2a0-43cd-87f9-6e7396b2b99f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:29.491754 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 93/178] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:29 2022] GET /identity/v3/projects/3b838a465df34246a7cb874b18b986ee => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:29.493429 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d988-764e-42ec-818c-4aa34dd66c76 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.493863 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d988-764e-42ec-818c-4aa34dd66c76 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.494306 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d988-764e-42ec-818c-4aa34dd66c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.511659 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-df30d988-764e-42ec-818c-4aa34dd66c76 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:29.513102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df30d988-764e-42ec-818c-4aa34dd66c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:29.583895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 94/179] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:29.585186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d988-764e-42ec-818c-4aa34dd66c76 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:29.654324 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20948ac-58b1-4067-8654-25ab0c43f9ad None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:29.697174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d988-764e-42ec-818c-4aa34dd66c76 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:29.721247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71768e02-6eb4-43ce-bf34-59ba04928863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:29.724441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768e02-6eb4-43ce-bf34-59ba04928863 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.725182 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768e02-6eb4-43ce-bf34-59ba04928863 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.725884 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768e02-6eb4-43ce-bf34-59ba04928863 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.728459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71768e02-6eb4-43ce-bf34-59ba04928863 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:29.731498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71768e02-6eb4-43ce-bf34-59ba04928863 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:29.735102 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 86/180] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:29 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:29.736720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71768e02-6eb4-43ce-bf34-59ba04928863 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:29.744368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:29.745543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.745970 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.746474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.747527 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] RBAC: Adding query filter params (role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=3b838a465df34246a7cb874b18b986ee, user.id=d312d466cfd04c698b6812ee7c7c1fdc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:29.748042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:29.749765 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:29.756877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 95/181] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:29 2022] GET /identity/v3/role_assignments?user.id=d312d466cfd04c698b6812ee7c7c1fdc&scope.project.id=3b838a465df34246a7cb874b18b986ee&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:29.757963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:29.922322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71768e02-6eb4-43ce-bf34-59ba04928863 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:29.954845 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f91ed8-35c3-4527-8bb8-5627ec599899 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:29.964808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe480f0-b090-4430-a73c-572b552cbf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:29.967435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe480f0-b090-4430-a73c-572b552cbf5a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:29.973605 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe480f0-b090-4430-a73c-572b552cbf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:29.974286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe480f0-b090-4430-a73c-572b552cbf5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:29.994772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe480f0-b090-4430-a73c-572b552cbf5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8fe480f0-b090-4430-a73c-572b552cbf5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:30.004523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:30.005500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:30.006298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:30.009855 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 87/182] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:30.019421 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe480f0-b090-4430-a73c-572b552cbf5a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:30.054348 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e356e56-9fed-4d4f-b1df-88eccdce7d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:30.055509 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e356e56-9fed-4d4f-b1df-88eccdce7d4f None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.055956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e356e56-9fed-4d4f-b1df-88eccdce7d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.056370 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e356e56-9fed-4d4f-b1df-88eccdce7d4f None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/users/bee70c4330614497ade564790e71c24c/roles/2cb369a212074a9aae140dfa2d236368` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.062903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e356e56-9fed-4d4f-b1df-88eccdce7d4f None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b0c2761cb4387b2427fcd3c01356c, user_id=bee70c4330614497ade564790e71c24c, role_id=2cb369a212074a9aae140dfa2d236368)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:30.064699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e356e56-9fed-4d4f-b1df-88eccdce7d4f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:30.095450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 96/183] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:29 2022] PUT /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/users/bee70c4330614497ade564790e71c24c/roles/2cb369a212074a9aae140dfa2d236368 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:30.157616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60a59-374a-4017-98fe-fbb3daca509f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.158252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60a59-374a-4017-98fe-fbb3daca509f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.158533 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60a59-374a-4017-98fe-fbb3daca509f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.160779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 97/184] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:30.166680 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8150e2-1334-4c87-a53a-9e6a7a2ebdc9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.167300 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8150e2-1334-4c87-a53a-9e6a7a2ebdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.167827 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8150e2-1334-4c87-a53a-9e6a7a2ebdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.170927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe480f0-b090-4430-a73c-572b552cbf5a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:30.188233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-df8150e2-1334-4c87-a53a-9e6a7a2ebdc9 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:30.189905 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df8150e2-1334-4c87-a53a-9e6a7a2ebdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:30.223065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a41706-ce02-4797-a60d-53dee4b53538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:30.224251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41706-ce02-4797-a60d-53dee4b53538 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.224775 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41706-ce02-4797-a60d-53dee4b53538 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.225276 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41706-ce02-4797-a60d-53dee4b53538 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.226881 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41706-ce02-4797-a60d-53dee4b53538 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:30.227438 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41706-ce02-4797-a60d-53dee4b53538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:30.230322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41706-ce02-4797-a60d-53dee4b53538 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:30.247043 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 88/185] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:30.249622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09bc7-85c9-4a35-bf2c-67075684dea8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.250115 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09bc7-85c9-4a35-bf2c-67075684dea8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.250611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09bc7-85c9-4a35-bf2c-67075684dea8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.253255 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 89/186] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:30.257522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e09bc7-85c9-4a35-bf2c-67075684dea8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:30.282966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 98/187] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:30.284744 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f8d9-bfb7-4e7e-9813-7f2072a64688 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.285279 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f8d9-bfb7-4e7e-9813-7f2072a64688 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.285777 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f8d9-bfb7-4e7e-9813-7f2072a64688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.306059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6b96f8d9-bfb7-4e7e-9813-7f2072a64688 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:30.307628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6b96f8d9-bfb7-4e7e-9813-7f2072a64688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:30.393422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 99/188] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:30.394153 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96f8d9-bfb7-4e7e-9813-7f2072a64688 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:30.418081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e09bc7-85c9-4a35-bf2c-67075684dea8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:30.460163 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dab2b-57ed-4a77-a110-8aae1eaab2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:30.461081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dab2b-57ed-4a77-a110-8aae1eaab2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.461354 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dab2b-57ed-4a77-a110-8aae1eaab2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.461629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dab2b-57ed-4a77-a110-8aae1eaab2d2 None admin] PATH_INFO: `/v3/users/9f6508cd39a14c3b955c2248899ab52f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.475899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6dab2b-57ed-4a77-a110-8aae1eaab2d2 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6508cd39a14c3b955c2248899ab52f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:30.477439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6dab2b-57ed-4a77-a110-8aae1eaab2d2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:30.479863 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 90/189] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:30 2022] GET /identity/v3/users/9f6508cd39a14c3b955c2248899ab52f => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:30.481864 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dab2b-57ed-4a77-a110-8aae1eaab2d2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:30.536694 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96f8d9-bfb7-4e7e-9813-7f2072a64688 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:30.578534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb0a50-c65d-492d-866a-a3bb722b6a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:30.579949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb0a50-c65d-492d-866a-a3bb722b6a03 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.580417 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb0a50-c65d-492d-866a-a3bb722b6a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.580944 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb0a50-c65d-492d-866a-a3bb722b6a03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.600132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb0a50-c65d-492d-866a-a3bb722b6a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:30.606864 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dab2b-57ed-4a77-a110-8aae1eaab2d2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-28eb0a50-c65d-492d-866a-a3bb722b6a03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:30.608198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:30.609875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 100/190] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:58:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:30.611431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb0a50-c65d-492d-866a-a3bb722b6a03 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:30.675277 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466d731-0137-42d5-bc9b-fe71d67079c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:30.677742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d731-0137-42d5-bc9b-fe71d67079c0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.678227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d731-0137-42d5-bc9b-fe71d67079c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.678715 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d731-0137-42d5-bc9b-fe71d67079c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.680842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466d731-0137-42d5-bc9b-fe71d67079c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:30.683554 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466d731-0137-42d5-bc9b-fe71d67079c0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:30.691657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 91/191] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:30.691657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466d731-0137-42d5-bc9b-fe71d67079c0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:30.718211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb0a50-c65d-492d-866a-a3bb722b6a03 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:30.766432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff632f2b-bb96-4fc1-874c-7ee5324344f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:30.767216 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff632f2b-bb96-4fc1-874c-7ee5324344f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.767551 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff632f2b-bb96-4fc1-874c-7ee5324344f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.767832 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff632f2b-bb96-4fc1-874c-7ee5324344f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.823325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466d731-0137-42d5-bc9b-fe71d67079c0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:30.843928 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff632f2b-bb96-4fc1-874c-7ee5324344f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:30.846194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff632f2b-bb96-4fc1-874c-7ee5324344f7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:30.862266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:30.863129 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:30.863467 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:30.863599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:30.864343 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:30.864703 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:30.866145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:30.874981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 92/192] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:58:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:30.875784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:30.968008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 101/193] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:30.973250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff632f2b-bb96-4fc1-874c-7ee5324344f7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:31.001044 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30031ce9-dce2-4bd5-9552-da66506d8729 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:31.043260 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf938c-b8f0-46d4-8065-ab64c505497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:31.044169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf938c-b8f0-46d4-8065-ab64c505497e None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:31.044585 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf938c-b8f0-46d4-8065-ab64c505497e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:31.045021 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf938c-b8f0-46d4-8065-ab64c505497e None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:31.045885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf938c-b8f0-46d4-8065-ab64c505497e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:31.047635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf938c-b8f0-46d4-8065-ab64c505497e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:31.073534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 93/194] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:58:30 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:31.084073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf938c-b8f0-46d4-8065-ab64c505497e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:31.120037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff632f2b-bb96-4fc1-874c-7ee5324344f7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:31.159549 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cd1ab-8b4f-4d26-b72e-5be08e5862d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:31.161026 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cd1ab-8b4f-4d26-b72e-5be08e5862d8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:31.161404 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cd1ab-8b4f-4d26-b72e-5be08e5862d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:31.161730 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cd1ab-8b4f-4d26-b72e-5be08e5862d8 None admin] PATH_INFO: `/v3/users/9f6508cd39a14c3b955c2248899ab52f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:31.163728 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cd1ab-8b4f-4d26-b72e-5be08e5862d8 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6508cd39a14c3b955c2248899ab52f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:31.164717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cd1ab-8b4f-4d26-b72e-5be08e5862d8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:31.166911 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 102/195] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:30 2022] GET /identity/v3/users/9f6508cd39a14c3b955c2248899ab52f => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:31.172249 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cd1ab-8b4f-4d26-b72e-5be08e5862d8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:31.274768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf938c-b8f0-46d4-8065-ab64c505497e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:31.287871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cd1ab-8b4f-4d26-b72e-5be08e5862d8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:31.324765 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705860cb-60b7-4a0c-bc80-430b15e63a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:31.325431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705860cb-60b7-4a0c-bc80-430b15e63a0e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:31.325714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705860cb-60b7-4a0c-bc80-430b15e63a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:31.325992 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705860cb-60b7-4a0c-bc80-430b15e63a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:31.340198 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4737e-d5b4-4a14-88aa-cde9f620b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:31.341642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4737e-d5b4-4a14-88aa-cde9f620b365 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:31.342096 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4737e-d5b4-4a14-88aa-cde9f620b365 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:31.342561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4737e-d5b4-4a14-88aa-cde9f620b365 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:31.344734 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4737e-d5b4-4a14-88aa-cde9f620b365 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:31.348438 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4737e-d5b4-4a14-88aa-cde9f620b365 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:31.351977 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 94/196] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:31 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:31.359447 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4737e-d5b4-4a14-88aa-cde9f620b365 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:31.414038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705860cb-60b7-4a0c-bc80-430b15e63a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:31.415698 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705860cb-60b7-4a0c-bc80-430b15e63a0e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:31.511689 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4737e-d5b4-4a14-88aa-cde9f620b365 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:31.542607 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 103/197] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 13:58:31.548759 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:31.549439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:31.549725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:31.549998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:31.551757 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=e009c372f03c453eb347cdb038de6fab, user.id=9f6508cd39a14c3b955c2248899ab52f) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:31.552016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705860cb-60b7-4a0c-bc80-430b15e63a0e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:31.552122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:31.553547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:31.559946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 95/198] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:31 2022] GET /identity/v3/role_assignments?user.id=9f6508cd39a14c3b955c2248899ab52f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=52bf3a299728408b8384e30e08547fd8 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:31.666099 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705860cb-60b7-4a0c-bc80-430b15e63a0e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:31.712641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974d9d0-59a7-45f9-b362-4557e8e1adfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:31.714562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974d9d0-59a7-45f9-b362-4557e8e1adfa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:31.715256 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974d9d0-59a7-45f9-b362-4557e8e1adfa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:31.715943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974d9d0-59a7-45f9-b362-4557e8e1adfa None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:31.718614 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974d9d0-59a7-45f9-b362-4557e8e1adfa None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:31.722416 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974d9d0-59a7-45f9-b362-4557e8e1adfa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:31.726199 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 104/199] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:31 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:31.736027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:31.869400 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d624772-a65f-4de9-909b-f614d413a9bd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:31.909072 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c09d5-ab2a-400f-8c49-32647f98ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:31.910308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c09d5-ab2a-400f-8c49-32647f98ea4a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:31.910613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c09d5-ab2a-400f-8c49-32647f98ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:31.910900 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c09d5-ab2a-400f-8c49-32647f98ea4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:31.911737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c09d5-ab2a-400f-8c49-32647f98ea4a None admin] RBAC: Adding query filter params (role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=e009c372f03c453eb347cdb038de6fab, user.id=9f6508cd39a14c3b955c2248899ab52f) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:31.912049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c09d5-ab2a-400f-8c49-32647f98ea4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:31.913512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c09d5-ab2a-400f-8c49-32647f98ea4a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:31.919746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 96/200] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:31 2022] GET /identity/v3/role_assignments?user.id=9f6508cd39a14c3b955c2248899ab52f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:32.735601 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed80c-815c-4283-8c00-99d1c2c9c50b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:32.736503 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed80c-815c-4283-8c00-99d1c2c9c50b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:32.736976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed80c-815c-4283-8c00-99d1c2c9c50b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:32.738960 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 105/201] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:32.744926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482ba6-77c2-46dc-ac51-1de4806b1dd1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:32.745414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482ba6-77c2-46dc-ac51-1de4806b1dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:32.745486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482ba6-77c2-46dc-ac51-1de4806b1dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:32.774115 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-da482ba6-77c2-46dc-ac51-1de4806b1dd1 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:32.775357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-da482ba6-77c2-46dc-ac51-1de4806b1dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:32.858215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 97/202] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:32.889087 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ed80c-815c-4283-8c00-99d1c2c9c50b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:33.053800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ed80c-815c-4283-8c00-99d1c2c9c50b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:33.110796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd129df-4bdd-404e-bdd8-88be8b283c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:33.111950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd129df-4bdd-404e-bdd8-88be8b283c42 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:33.112407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd129df-4bdd-404e-bdd8-88be8b283c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:33.113464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd129df-4bdd-404e-bdd8-88be8b283c42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:33.131563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd129df-4bdd-404e-bdd8-88be8b283c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0fd129df-4bdd-404e-bdd8-88be8b283c42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:33.140432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:33.141351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:33.142137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:33.144559 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 106/203] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:33.153888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da482ba6-77c2-46dc-ac51-1de4806b1dd1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:33.268526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da482ba6-77c2-46dc-ac51-1de4806b1dd1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:33.311952 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:33.312567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:33.312876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:33.313155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:33.313924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:33.314230 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:33.315621 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:33.324834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 98/204] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:33.330390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd129df-4bdd-404e-bdd8-88be8b283c42 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:33.483699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd129df-4bdd-404e-bdd8-88be8b283c42 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:33.530741 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2cf61-284b-4562-b824-6fa985e29b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:33.532023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2cf61-284b-4562-b824-6fa985e29b7a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:33.532497 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2cf61-284b-4562-b824-6fa985e29b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:33.533014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2cf61-284b-4562-b824-6fa985e29b7a None admin] PATH_INFO: `/v3/users/bee70c4330614497ade564790e71c24c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:33.534484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2cf61-284b-4562-b824-6fa985e29b7a None admin] RBAC: Authorizing `identity:get_user(user_id=bee70c4330614497ade564790e71c24c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:33.536175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2cf61-284b-4562-b824-6fa985e29b7a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:33.538052 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 107/205] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:33 2022] GET /identity/v3/users/bee70c4330614497ade564790e71c24c => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:33.543547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:33.688005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d079-df61-4dc0-a741-b276daeb878c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:33.740606 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6408bb-5e80-4c79-a3b4-3cc0f07efe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:33.741322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6408bb-5e80-4c79-a3b4-3cc0f07efe0f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:33.741605 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6408bb-5e80-4c79-a3b4-3cc0f07efe0f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:33.741881 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6408bb-5e80-4c79-a3b4-3cc0f07efe0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:33.840701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6408bb-5e80-4c79-a3b4-3cc0f07efe0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:33.842225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6408bb-5e80-4c79-a3b4-3cc0f07efe0f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:33.980347 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 99/206] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:33.985875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2cf61-284b-4562-b824-6fa985e29b7a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:34.153965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2cf61-284b-4562-b824-6fa985e29b7a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:34.202556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf3213-9eaa-4061-9353-e16a6d208473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:34.203830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3213-9eaa-4061-9353-e16a6d208473 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.204308 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3213-9eaa-4061-9353-e16a6d208473 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.204812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3213-9eaa-4061-9353-e16a6d208473 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.208635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf3213-9eaa-4061-9353-e16a6d208473 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:34.210381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf3213-9eaa-4061-9353-e16a6d208473 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:34.212425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 108/207] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:33 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:34.218377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6408bb-5e80-4c79-a3b4-3cc0f07efe0f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:34.277287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779835-87d8-4de1-aa22-b5f340b2fa33 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.280701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779835-87d8-4de1-aa22-b5f340b2fa33 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.280701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779835-87d8-4de1-aa22-b5f340b2fa33 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.280701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 109/208] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:34.297748 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a6ba-224a-43c8-b749-a53d73c42276 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.298125 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a6ba-224a-43c8-b749-a53d73c42276 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.298476 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a6ba-224a-43c8-b749-a53d73c42276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.330217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-23d3a6ba-224a-43c8-b749-a53d73c42276 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:34.331407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-23d3a6ba-224a-43c8-b749-a53d73c42276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:34.349308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6408bb-5e80-4c79-a3b4-3cc0f07efe0f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:34.389761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:34.390442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.390726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.391005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.391847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] RBAC: Adding query filter params (role.id=2cb369a212074a9aae140dfa2d236368, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c, user.id=bee70c4330614497ade564790e71c24c) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:34.392156 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:34.393640 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:34.413105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 100/209] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:34 2022] GET /identity/v3/role_assignments?user.id=bee70c4330614497ade564790e71c24c&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=2cb369a212074a9aae140dfa2d236368 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:34.460595 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 110/210] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:34.506418 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:34.652691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d32b4-0548-4be3-9800-0f0d52a1ff3f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:34.700405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a70a8-845c-4b92-bbc0-4a57f5ec7c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:34.701262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a70a8-845c-4b92-bbc0-4a57f5ec7c49 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.701547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a70a8-845c-4b92-bbc0-4a57f5ec7c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.701816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a70a8-845c-4b92-bbc0-4a57f5ec7c49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.704072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b5bc-cc3b-4624-98f6-44240a950fb7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.704357 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b5bc-cc3b-4624-98f6-44240a950fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.704631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b5bc-cc3b-4624-98f6-44240a950fb7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.706086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 111/211] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:34.718241 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce59e0-b047-41ee-a647-5f84a90a36be None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.718573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce59e0-b047-41ee-a647-5f84a90a36be None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.718799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce59e0-b047-41ee-a647-5f84a90a36be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.720841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a70a8-845c-4b92-bbc0-4a57f5ec7c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-964a70a8-845c-4b92-bbc0-4a57f5ec7c49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:34.730645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:34.731578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:34.732515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 101/212] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:34.742202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a70a8-845c-4b92-bbc0-4a57f5ec7c49 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:34.763236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fdce59e0-b047-41ee-a647-5f84a90a36be None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:34.764474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fdce59e0-b047-41ee-a647-5f84a90a36be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:34.883464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 112/213] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:34.904970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a70a8-845c-4b92-bbc0-4a57f5ec7c49 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:34.913700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce59e0-b047-41ee-a647-5f84a90a36be None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:34.949153 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18eb26-a6f2-4422-877e-d71c2737d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:34.949812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18eb26-a6f2-4422-877e-d71c2737d96b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.950288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18eb26-a6f2-4422-877e-d71c2737d96b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.950641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18eb26-a6f2-4422-877e-d71c2737d96b None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.951419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18eb26-a6f2-4422-877e-d71c2737d96b None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:34.951824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18eb26-a6f2-4422-877e-d71c2737d96b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:34.953342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18eb26-a6f2-4422-877e-d71c2737d96b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:34.963414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 102/214] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:34.978113 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c033eb-f72e-4645-a51b-bc7e30748187 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:34.978113 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c033eb-f72e-4645-a51b-bc7e30748187 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:34.978113 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c033eb-f72e-4645-a51b-bc7e30748187 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:34.979665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 103/215] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:34.979895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c033eb-f72e-4645-a51b-bc7e30748187 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.043208 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce59e0-b047-41ee-a647-5f84a90a36be None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.077136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3be02-d9f9-4d49-8a16-16b168677ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.078104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3be02-d9f9-4d49-8a16-16b168677ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.078240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3be02-d9f9-4d49-8a16-16b168677ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.078510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3be02-d9f9-4d49-8a16-16b168677ce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.079807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3be02-d9f9-4d49-8a16-16b168677ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:35.081312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3be02-d9f9-4d49-8a16-16b168677ce4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:35.087623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 113/216] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:35.087623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42863b7-251e-4413-a06d-d45589433912 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.087623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42863b7-251e-4413-a06d-d45589433912 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.087623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42863b7-251e-4413-a06d-d45589433912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.095654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c033eb-f72e-4645-a51b-bc7e30748187 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.102708 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b42863b7-251e-4413-a06d-d45589433912 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:35.103945 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b42863b7-251e-4413-a06d-d45589433912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:35.132998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956edf-03fb-4560-b5b3-fd67d8a16510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.133900 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956edf-03fb-4560-b5b3-fd67d8a16510 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.134182 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956edf-03fb-4560-b5b3-fd67d8a16510 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.134458 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956edf-03fb-4560-b5b3-fd67d8a16510 None admin] PATH_INFO: `/v3/users/a716343775ef42de98eded64008f628f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.151473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8956edf-03fb-4560-b5b3-fd67d8a16510 None admin] RBAC: Authorizing `identity:get_user(user_id=a716343775ef42de98eded64008f628f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:35.152931 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8956edf-03fb-4560-b5b3-fd67d8a16510 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:35.156028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 104/217] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:34 2022] GET /identity/v3/users/a716343775ef42de98eded64008f628f => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:35.156028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956edf-03fb-4560-b5b3-fd67d8a16510 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.179038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 114/218] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:35.180376 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5cf5c-13f2-4ccc-a82f-d76b193677f6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.180664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5cf5c-13f2-4ccc-a82f-d76b193677f6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.180969 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5cf5c-13f2-4ccc-a82f-d76b193677f6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.182398 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 115/219] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:35.185960 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5cf5c-13f2-4ccc-a82f-d76b193677f6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.273339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956edf-03fb-4560-b5b3-fd67d8a16510 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.292558 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5cf5c-13f2-4ccc-a82f-d76b193677f6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.311669 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d13fbc-a770-434a-ac98-759c0c862100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.312340 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13fbc-a770-434a-ac98-759c0c862100 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.312619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13fbc-a770-434a-ac98-759c0c862100 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.312918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13fbc-a770-434a-ac98-759c0c862100 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.313627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d13fbc-a770-434a-ac98-759c0c862100 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:35.315051 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d13fbc-a770-434a-ac98-759c0c862100 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:35.326357 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3590e-61b7-4239-908d-fb340ff87719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.327143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3590e-61b7-4239-908d-fb340ff87719 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.327459 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3590e-61b7-4239-908d-fb340ff87719 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.327846 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3590e-61b7-4239-908d-fb340ff87719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.335580 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 105/220] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:58:35 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:35.336868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1050d8-0601-42ea-a244-60ee8b6d20fa None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.337155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1050d8-0601-42ea-a244-60ee8b6d20fa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.337686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1050d8-0601-42ea-a244-60ee8b6d20fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.355808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3d1050d8-0601-42ea-a244-60ee8b6d20fa None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:35.357551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3d1050d8-0601-42ea-a244-60ee8b6d20fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:35.440235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3590e-61b7-4239-908d-fb340ff87719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:35.441840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3590e-61b7-4239-908d-fb340ff87719 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:35.453024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 106/221] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:35.465014 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1050d8-0601-42ea-a244-60ee8b6d20fa None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.563575 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1050d8-0601-42ea-a244-60ee8b6d20fa None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.574246 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 116/222] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:35.575200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3590e-61b7-4239-908d-fb340ff87719 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.609059 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961e847-45b0-4511-95b6-9643a124ba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.610016 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e847-45b0-4511-95b6-9643a124ba46 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.611118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e847-45b0-4511-95b6-9643a124ba46 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.611118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e847-45b0-4511-95b6-9643a124ba46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.624456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961e847-45b0-4511-95b6-9643a124ba46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3961e847-45b0-4511-95b6-9643a124ba46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:35.633569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:35.634557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:35.635414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 107/223] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:58:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:35.636140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961e847-45b0-4511-95b6-9643a124ba46 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.709335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3590e-61b7-4239-908d-fb340ff87719 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.760700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48168db-cdf3-4131-9a4b-91af9591df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.761524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48168db-cdf3-4131-9a4b-91af9591df96 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.761809 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48168db-cdf3-4131-9a4b-91af9591df96 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.762107 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48168db-cdf3-4131-9a4b-91af9591df96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.774083 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48168db-cdf3-4131-9a4b-91af9591df96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:35.778305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961e847-45b0-4511-95b6-9643a124ba46 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d48168db-cdf3-4131-9a4b-91af9591df96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:35.781932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:35.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 117/224] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:35.786488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48168db-cdf3-4131-9a4b-91af9591df96 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.822961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf973-1cdd-441f-b940-f83c3f64ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.823835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf973-1cdd-441f-b940-f83c3f64ce3f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.824115 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf973-1cdd-441f-b940-f83c3f64ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.824386 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf973-1cdd-441f-b940-f83c3f64ce3f None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.825625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febf973-1cdd-441f-b940-f83c3f64ce3f None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:35.827071 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febf973-1cdd-441f-b940-f83c3f64ce3f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:35.828814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 108/225] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:35 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:35.829671 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf973-1cdd-441f-b940-f83c3f64ce3f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.907572 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48168db-cdf3-4131-9a4b-91af9591df96 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.934441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf973-1cdd-441f-b940-f83c3f64ce3f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:35.950499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.951478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.951953 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.952385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.953392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:35.953840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:35.955426 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:35.964454 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 118/226] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:58:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:35.965766 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:35.969608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:35.970832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:35.970832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:35.970832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:35.971838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:35.972694 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:35.974541 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:35.983355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 109/227] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:35.988522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:36.082990 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eac932-6a18-470a-addb-54ef46842ad0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:36.103068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6124341-d946-4931-8f98-f1b013fa805d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:36.120943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:36.122130 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:36.122613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:36.123126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:36.124160 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] RBAC: Adding query filter params (role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=e009c372f03c453eb347cdb038de6fab, user.id=a716343775ef42de98eded64008f628f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:36.124702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:36.126462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:36.133609 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 119/228] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:35 2022] GET /identity/v3/role_assignments?user.id=a716343775ef42de98eded64008f628f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:36.134861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:36.141063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fc8f0-ebad-4cee-9662-0a57d44ea5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:36.141978 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fc8f0-ebad-4cee-9662-0a57d44ea5ef None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:36.142261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fc8f0-ebad-4cee-9662-0a57d44ea5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:36.142537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fc8f0-ebad-4cee-9662-0a57d44ea5ef None admin] PATH_INFO: `/v3/users/9f6508cd39a14c3b955c2248899ab52f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:36.143889 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fc8f0-ebad-4cee-9662-0a57d44ea5ef None admin] RBAC: Authorizing `identity:get_user(user_id=9f6508cd39a14c3b955c2248899ab52f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:36.145859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fc8f0-ebad-4cee-9662-0a57d44ea5ef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:36.147872 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 110/229] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:35 2022] GET /identity/v3/users/9f6508cd39a14c3b955c2248899ab52f => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:36.153753 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fc8f0-ebad-4cee-9662-0a57d44ea5ef None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:36.250754 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eba46-7be1-40ff-826d-e2e28ab3748c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:36.263074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fc8f0-ebad-4cee-9662-0a57d44ea5ef None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:36.291477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50525-aac4-404a-bc72-9ac0f2695a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:36.293129 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50525-aac4-404a-bc72-9ac0f2695a00 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:36.293417 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50525-aac4-404a-bc72-9ac0f2695a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:36.293699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50525-aac4-404a-bc72-9ac0f2695a00 None admin] PATH_INFO: `/v3/users/9f6508cd39a14c3b955c2248899ab52f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:36.295359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf50525-aac4-404a-bc72-9ac0f2695a00 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6508cd39a14c3b955c2248899ab52f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:36.297325 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf50525-aac4-404a-bc72-9ac0f2695a00 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:36.300088 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 120/230] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:36 2022] GET /identity/v3/users/9f6508cd39a14c3b955c2248899ab52f => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:36.304791 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026044f-08e5-4243-86a1-3fc105b3768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:36.304791 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026044f-08e5-4243-86a1-3fc105b3768d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:36.305038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026044f-08e5-4243-86a1-3fc105b3768d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:36.305752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026044f-08e5-4243-86a1-3fc105b3768d None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:36.306913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50525-aac4-404a-bc72-9ac0f2695a00 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:36.307976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026044f-08e5-4243-86a1-3fc105b3768d None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:36.309589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026044f-08e5-4243-86a1-3fc105b3768d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:36.316826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 111/231] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:36 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:36.318713 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026044f-08e5-4243-86a1-3fc105b3768d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:36.426163 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50525-aac4-404a-bc72-9ac0f2695a00 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:36.428793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026044f-08e5-4243-86a1-3fc105b3768d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:36.463795 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821615-02a4-44f0-9b08-bb4b9f385e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:36.465115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821615-02a4-44f0-9b08-bb4b9f385e3e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:36.465600 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821615-02a4-44f0-9b08-bb4b9f385e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:36.466101 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821615-02a4-44f0-9b08-bb4b9f385e3e None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:36.467563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b821615-02a4-44f0-9b08-bb4b9f385e3e None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:36.469312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b821615-02a4-44f0-9b08-bb4b9f385e3e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:36.472009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 121/232] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:36 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:36.476785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262cea9-e17a-443c-892e-89ca9f3c9359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:36.476785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262cea9-e17a-443c-892e-89ca9f3c9359 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:36.476785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262cea9-e17a-443c-892e-89ca9f3c9359 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:36.476785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262cea9-e17a-443c-892e-89ca9f3c9359 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab/users/9f6508cd39a14c3b955c2248899ab52f/roles/b38b04aec27e41b9a8c2824918eedd12` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:36.479221 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821615-02a4-44f0-9b08-bb4b9f385e3e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:36.479881 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262cea9-e17a-443c-892e-89ca9f3c9359 None admin] RBAC: Authorizing `identity:create_grant(project_id=e009c372f03c453eb347cdb038de6fab, user_id=9f6508cd39a14c3b955c2248899ab52f, role_id=b38b04aec27e41b9a8c2824918eedd12)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:36.481384 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262cea9-e17a-443c-892e-89ca9f3c9359 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:36.519106 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 112/233] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:36 2022] PUT /identity/v3/projects/e009c372f03c453eb347cdb038de6fab/users/9f6508cd39a14c3b955c2248899ab52f/roles/b38b04aec27e41b9a8c2824918eedd12 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 13:58:36.629553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821615-02a4-44f0-9b08-bb4b9f385e3e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:36.673982 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daee00-7434-4034-9e6d-e049017198c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:36.675250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daee00-7434-4034-9e6d-e049017198c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:36.675538 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daee00-7434-4034-9e6d-e049017198c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:36.675810 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daee00-7434-4034-9e6d-e049017198c5 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab/users/9f6508cd39a14c3b955c2248899ab52f/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:36.678331 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daee00-7434-4034-9e6d-e049017198c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e009c372f03c453eb347cdb038de6fab, user_id=9f6508cd39a14c3b955c2248899ab52f, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:36.679853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daee00-7434-4034-9e6d-e049017198c5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:36.697617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 122/234] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:36 2022] PUT /identity/v3/projects/e009c372f03c453eb347cdb038de6fab/users/9f6508cd39a14c3b955c2248899ab52f/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 13:58:38.233956 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3be7-d0ac-44bf-8b82-8589a1070ac3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:38.234461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3be7-d0ac-44bf-8b82-8589a1070ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:38.234461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3be7-d0ac-44bf-8b82-8589a1070ac3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:38.236267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 113/235] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:38.242972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396d248-d6bd-440b-ba13-e91f3175ae2d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:38.243512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396d248-d6bd-440b-ba13-e91f3175ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:38.243512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396d248-d6bd-440b-ba13-e91f3175ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:38.261751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6396d248-d6bd-440b-ba13-e91f3175ae2d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:38.262946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6396d248-d6bd-440b-ba13-e91f3175ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:38.353983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 123/236] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:38.385656 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec3be7-d0ac-44bf-8b82-8589a1070ac3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:38.498322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec3be7-d0ac-44bf-8b82-8589a1070ac3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:38.506786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a538-84d1-4567-9edb-8b8488360e4e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:38.507085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a538-84d1-4567-9edb-8b8488360e4e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:38.507340 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a538-84d1-4567-9edb-8b8488360e4e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:38.509073 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 124/237] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:38.516113 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce12d-60f5-49a9-afec-3f5af7184b1f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:38.516861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce12d-60f5-49a9-afec-3f5af7184b1f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:38.517348 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce12d-60f5-49a9-afec-3f5af7184b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:38.542001 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52655-6f92-4f05-8591-dcff2b43950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:38.542823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52655-6f92-4f05-8591-dcff2b43950b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:38.543099 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52655-6f92-4f05-8591-dcff2b43950b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:38.543425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52655-6f92-4f05-8591-dcff2b43950b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:38.548699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52655-6f92-4f05-8591-dcff2b43950b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:38.548699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52655-6f92-4f05-8591-dcff2b43950b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:38.548699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 114/238] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:38.554976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52655-6f92-4f05-8591-dcff2b43950b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:38.561594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e16ce12d-60f5-49a9-afec-3f5af7184b1f None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:38.562766 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e16ce12d-60f5-49a9-afec-3f5af7184b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:38.699936 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52655-6f92-4f05-8591-dcff2b43950b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:38.738224 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2694ff-1179-49a8-9e08-469988d5677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:38.739086 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2694ff-1179-49a8-9e08-469988d5677b None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:38.739393 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2694ff-1179-49a8-9e08-469988d5677b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:38.739662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2694ff-1179-49a8-9e08-469988d5677b None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:38.740373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2694ff-1179-49a8-9e08-469988d5677b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:38.741964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2694ff-1179-49a8-9e08-469988d5677b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:38.746325 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 125/239] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:38.771003 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ce12d-60f5-49a9-afec-3f5af7184b1f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:38.784183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 115/240] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:58:38 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:38.965076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ce12d-60f5-49a9-afec-3f5af7184b1f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:39.014411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abbdb6-adca-44bd-ae24-786670e4de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:39.015295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbdb6-adca-44bd-ae24-786670e4de41 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.015595 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbdb6-adca-44bd-ae24-786670e4de41 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.016185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbdb6-adca-44bd-ae24-786670e4de41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.017441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b31f8-634b-405d-80cd-79a857ba2be6 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.017723 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b31f8-634b-405d-80cd-79a857ba2be6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.017997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b31f8-634b-405d-80cd-79a857ba2be6 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.019464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 116/241] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:39.025298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566472e-4d8e-471b-8e47-cecffacce685 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.025544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566472e-4d8e-471b-8e47-cecffacce685 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.025775 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566472e-4d8e-471b-8e47-cecffacce685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.037371 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abbdb6-adca-44bd-ae24-786670e4de41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-66abbdb6-adca-44bd-ae24-786670e4de41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:39.045207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:39.046173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:39.046963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:39.052259 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 126/242] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:39.053663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abbdb6-adca-44bd-ae24-786670e4de41 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:39.055789 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f566472e-4d8e-471b-8e47-cecffacce685 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:39.060043 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f566472e-4d8e-471b-8e47-cecffacce685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:39.157373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 117/243] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:39.183321 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abbdb6-adca-44bd-ae24-786670e4de41 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:39.186826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566472e-4d8e-471b-8e47-cecffacce685 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:39.226235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:39.226788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.227082 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.227354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.228122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:39.228425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:39.229997 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:39.243982 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 127/244] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:39.245226 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:39.308559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566472e-4d8e-471b-8e47-cecffacce685 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:39.346387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc2f5d-2734-40ce-bc6c-f20fb6b5995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:39.348184 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc2f5d-2734-40ce-bc6c-f20fb6b5995a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.348690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc2f5d-2734-40ce-bc6c-f20fb6b5995a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.349201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc2f5d-2734-40ce-bc6c-f20fb6b5995a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.357076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9463e17-711e-4a37-a443-5fc5e724f063 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:39.360979 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc2f5d-2734-40ce-bc6c-f20fb6b5995a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-eddc2f5d-2734-40ce-bc6c-f20fb6b5995a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:39.369986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:39.370959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:39.371737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:39.374204 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 118/245] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:39.381444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc2f5d-2734-40ce-bc6c-f20fb6b5995a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:39.394391 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ea60-1f07-4c40-9651-e4f632dfa1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:39.395671 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ea60-1f07-4c40-9651-e4f632dfa1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.395956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ea60-1f07-4c40-9651-e4f632dfa1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.396232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ea60-1f07-4c40-9651-e4f632dfa1d7 None admin] PATH_INFO: `/v3/users/1cc6e5e1a63c4f8780704ac82265e7db` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.414173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74ea60-1f07-4c40-9651-e4f632dfa1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=1cc6e5e1a63c4f8780704ac82265e7db)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:39.415673 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74ea60-1f07-4c40-9651-e4f632dfa1d7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:39.421990 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 128/246] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:39 2022] GET /identity/v3/users/1cc6e5e1a63c4f8780704ac82265e7db => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:39.423273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ea60-1f07-4c40-9651-e4f632dfa1d7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:39.491495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc2f5d-2734-40ce-bc6c-f20fb6b5995a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:39.539400 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:39.540794 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.541726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.542012 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.542887 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:39.543200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:39.544652 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:39.548198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ea60-1f07-4c40-9651-e4f632dfa1d7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:39.559749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 119/247] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:39.565618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:39.604419 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331dc4c-1894-4755-b7ee-5c900184577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:39.606463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331dc4c-1894-4755-b7ee-5c900184577e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.607709 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331dc4c-1894-4755-b7ee-5c900184577e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.608194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331dc4c-1894-4755-b7ee-5c900184577e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.696704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331dc4c-1894-4755-b7ee-5c900184577e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:39.698237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331dc4c-1894-4755-b7ee-5c900184577e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:39.706108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4e961-98f7-4a43-b1b7-3d396e1fdafe None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:39.754281 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546e3fa-bf8b-467f-9355-0ecb421653b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:39.755173 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546e3fa-bf8b-467f-9355-0ecb421653b2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.755454 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546e3fa-bf8b-467f-9355-0ecb421653b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.755725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546e3fa-bf8b-467f-9355-0ecb421653b2 None admin] PATH_INFO: `/v3/users/a716343775ef42de98eded64008f628f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.757732 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546e3fa-bf8b-467f-9355-0ecb421653b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a716343775ef42de98eded64008f628f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:39.759230 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546e3fa-bf8b-467f-9355-0ecb421653b2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:39.761040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 120/248] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:39 2022] GET /identity/v3/users/a716343775ef42de98eded64008f628f => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:39.762261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02b5c-fe96-44dd-a1f0-55d79c1e988a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.762544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02b5c-fe96-44dd-a1f0-55d79c1e988a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.762819 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02b5c-fe96-44dd-a1f0-55d79c1e988a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.764161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 121/249] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:39.770177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02b5c-fe96-44dd-a1f0-55d79c1e988a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:39.826819 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 129/250] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 13:58:39.831129 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67e87-f601-48d7-bc47-77e7b6c3a9a6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.832211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67e87-f601-48d7-bc47-77e7b6c3a9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.833009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67e87-f601-48d7-bc47-77e7b6c3a9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.851683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-41e67e87-f601-48d7-bc47-77e7b6c3a9a6 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:39.853296 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-41e67e87-f601-48d7-bc47-77e7b6c3a9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:39.880140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02b5c-fe96-44dd-a1f0-55d79c1e988a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:39.919046 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd974ff-ba51-4db2-b32c-8b9e37e370aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:39.920214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd974ff-ba51-4db2-b32c-8b9e37e370aa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.920806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd974ff-ba51-4db2-b32c-8b9e37e370aa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.921281 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd974ff-ba51-4db2-b32c-8b9e37e370aa None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.922822 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd974ff-ba51-4db2-b32c-8b9e37e370aa None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:39.924766 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd974ff-ba51-4db2-b32c-8b9e37e370aa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:39.925760 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 130/251] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:39.926683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67e87-f601-48d7-bc47-77e7b6c3a9a6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:39.928503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 122/252] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:39 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:39.930097 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5999-ebe3-48ad-bcca-24d7d7b02c26 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:39.930586 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5999-ebe3-48ad-bcca-24d7d7b02c26 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:39.931058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5999-ebe3-48ad-bcca-24d7d7b02c26 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:39.933015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 123/253] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:39.934249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd5999-ebe3-48ad-bcca-24d7d7b02c26 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:40.034244 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67e87-f601-48d7-bc47-77e7b6c3a9a6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:40.049799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd5999-ebe3-48ad-bcca-24d7d7b02c26 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:40.069996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2121c-5cca-497a-bea7-de07b4734f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:40.071224 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2121c-5cca-497a-bea7-de07b4734f78 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.071734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2121c-5cca-497a-bea7-de07b4734f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.072198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2121c-5cca-497a-bea7-de07b4734f78 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.073580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2121c-5cca-497a-bea7-de07b4734f78 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:40.075263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2121c-5cca-497a-bea7-de07b4734f78 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:40.077601 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 131/254] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:39 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:40.078916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea285-3d6a-4864-8c18-14d0d9546121 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.079277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea285-3d6a-4864-8c18-14d0d9546121 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.079628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea285-3d6a-4864-8c18-14d0d9546121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.088840 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37afc3e-e5cf-44f7-99d7-4d6bfc206a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:40.090194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37afc3e-e5cf-44f7-99d7-4d6bfc206a94 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.090686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37afc3e-e5cf-44f7-99d7-4d6bfc206a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.091132 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37afc3e-e5cf-44f7-99d7-4d6bfc206a94 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab/users/a716343775ef42de98eded64008f628f/roles/8e27b8e86fc845e9b8569e559e21603f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.093791 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37afc3e-e5cf-44f7-99d7-4d6bfc206a94 None admin] RBAC: Authorizing `identity:create_grant(project_id=e009c372f03c453eb347cdb038de6fab, user_id=a716343775ef42de98eded64008f628f, role_id=8e27b8e86fc845e9b8569e559e21603f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:40.095748 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37afc3e-e5cf-44f7-99d7-4d6bfc206a94 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:40.099631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9bbea285-3d6a-4864-8c18-14d0d9546121 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:40.101040 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9bbea285-3d6a-4864-8c18-14d0d9546121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:40.113766 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 124/255] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:39 2022] PUT /identity/v3/projects/e009c372f03c453eb347cdb038de6fab/users/a716343775ef42de98eded64008f628f/roles/8e27b8e86fc845e9b8569e559e21603f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:40.120150 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37afc3e-e5cf-44f7-99d7-4d6bfc206a94 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:40.240229 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 132/256] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:40.241811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbea285-3d6a-4864-8c18-14d0d9546121 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:40.305711 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37afc3e-e5cf-44f7-99d7-4d6bfc206a94 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:40.383762 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d3e2-15bb-4fa0-96ed-67882b37e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:40.384561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d3e2-15bb-4fa0-96ed-67882b37e421 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.386170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d3e2-15bb-4fa0-96ed-67882b37e421 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.386461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d3e2-15bb-4fa0-96ed-67882b37e421 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.401278 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34d3e2-15bb-4fa0-96ed-67882b37e421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5e34d3e2-15bb-4fa0-96ed-67882b37e421 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:40.411546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:40.412570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:40.413427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:40.414602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 125/257] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:40.417480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d3e2-15bb-4fa0-96ed-67882b37e421 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:40.432409 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbea285-3d6a-4864-8c18-14d0d9546121 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:40.468988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:40.469655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.469939 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.470226 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.471065 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] RBAC: Adding query filter params (role.id=2cb369a212074a9aae140dfa2d236368, scope.project.id=e009c372f03c453eb347cdb038de6fab, user.id=1cc6e5e1a63c4f8780704ac82265e7db) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:40.471626 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:40.474236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:40.480878 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 133/258] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:40 2022] GET /identity/v3/role_assignments?user.id=1cc6e5e1a63c4f8780704ac82265e7db&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=2cb369a212074a9aae140dfa2d236368 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:40.481309 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:40.536081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d3e2-15bb-4fa0-96ed-67882b37e421 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:40.573056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469955-119e-4598-aa05-a70f3bc579be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:40.574246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469955-119e-4598-aa05-a70f3bc579be None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.574916 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469955-119e-4598-aa05-a70f3bc579be None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.575468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469955-119e-4598-aa05-a70f3bc579be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.587628 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94469955-119e-4598-aa05-a70f3bc579be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:40.594035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb6fe7-5392-4233-a738-f30615919b94 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-94469955-119e-4598-aa05-a70f3bc579be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:40.597356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:40.598582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:40.599398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:40.601929 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 126/259] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:58:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:40.607841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469955-119e-4598-aa05-a70f3bc579be None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:40.660693 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:40.662264 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.662559 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.662885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.663666 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:40.664775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:40.666466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:40.689985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 134/260] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:40.696530 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:40.826820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469955-119e-4598-aa05-a70f3bc579be None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:40.892482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:40.893198 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.893485 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.893761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.895249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:40.895788 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:40.897251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:40.904737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c24895-9610-4508-80cc-2d00ef25256e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:40.920349 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 127/261] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:58:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:40.925793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:40.957804 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f26bad-6313-441b-bef3-bd179b693b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:40.958847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26bad-6313-441b-bef3-bd179b693b8f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:40.959517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26bad-6313-441b-bef3-bd179b693b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:40.959810 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26bad-6313-441b-bef3-bd179b693b8f None admin] PATH_INFO: `/v3/users/9f6508cd39a14c3b955c2248899ab52f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:40.961083 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f26bad-6313-441b-bef3-bd179b693b8f None admin] RBAC: Authorizing `identity:get_user(user_id=9f6508cd39a14c3b955c2248899ab52f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:40.962658 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f26bad-6313-441b-bef3-bd179b693b8f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:40.964309 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 135/262] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:40 2022] GET /identity/v3/users/9f6508cd39a14c3b955c2248899ab52f => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:40.973781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f26bad-6313-441b-bef3-bd179b693b8f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:41.169846 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f26bad-6313-441b-bef3-bd179b693b8f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:41.196547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28470-15a6-4b7c-8b06-ec3c5e390eb4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:41.236885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc3979-ce1a-41d4-9d72-8f7feeec42ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:41.238458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc3979-ce1a-41d4-9d72-8f7feeec42ae None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:41.238864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc3979-ce1a-41d4-9d72-8f7feeec42ae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:41.239353 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc3979-ce1a-41d4-9d72-8f7feeec42ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:41.268807 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94467e-80da-443b-9896-9c1a222a3346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:41.271798 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94467e-80da-443b-9896-9c1a222a3346 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:41.272088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94467e-80da-443b-9896-9c1a222a3346 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:41.272351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94467e-80da-443b-9896-9c1a222a3346 None admin] PATH_INFO: `/v3/users/9f6508cd39a14c3b955c2248899ab52f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:41.275647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94467e-80da-443b-9896-9c1a222a3346 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6508cd39a14c3b955c2248899ab52f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:41.277164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94467e-80da-443b-9896-9c1a222a3346 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:41.280761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 128/263] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:40 2022] GET /identity/v3/users/9f6508cd39a14c3b955c2248899ab52f => generated 283 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:41.289863 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94467e-80da-443b-9896-9c1a222a3346 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:41.401197 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94467e-80da-443b-9896-9c1a222a3346 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:41.402866 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc3979-ce1a-41d4-9d72-8f7feeec42ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:41.404377 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc3979-ce1a-41d4-9d72-8f7feeec42ae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:41.437293 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63b0c-45fd-428f-a435-fccd206249b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:41.437954 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63b0c-45fd-428f-a435-fccd206249b0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:41.438235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63b0c-45fd-428f-a435-fccd206249b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:41.438512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63b0c-45fd-428f-a435-fccd206249b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:41.513387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d63b0c-45fd-428f-a435-fccd206249b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:41.514926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d63b0c-45fd-428f-a435-fccd206249b0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:41.626209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 129/264] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 13:58:41.631973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63b0c-45fd-428f-a435-fccd206249b0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:41.657979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 136/265] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 13:58:41.663968 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc3979-ce1a-41d4-9d72-8f7feeec42ae None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:41.802559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63b0c-45fd-428f-a435-fccd206249b0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:41.839220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e37c3d-d5c4-47cf-ba80-a243070b7299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:41.840093 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e37c3d-d5c4-47cf-ba80-a243070b7299 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:41.840373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e37c3d-d5c4-47cf-ba80-a243070b7299 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:41.840646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e37c3d-d5c4-47cf-ba80-a243070b7299 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:41.841919 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e37c3d-d5c4-47cf-ba80-a243070b7299 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:41.843368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e37c3d-d5c4-47cf-ba80-a243070b7299 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:41.845143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 130/266] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:41 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:41.851990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e37c3d-d5c4-47cf-ba80-a243070b7299 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:41.876559 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc3979-ce1a-41d4-9d72-8f7feeec42ae None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:41.961412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e37c3d-d5c4-47cf-ba80-a243070b7299 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:41.969373 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30479d3-ae44-422c-9f66-a344d09f0d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:41.970247 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30479d3-ae44-422c-9f66-a344d09f0d12 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:41.970521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30479d3-ae44-422c-9f66-a344d09f0d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:41.970790 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30479d3-ae44-422c-9f66-a344d09f0d12 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:41.972848 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30479d3-ae44-422c-9f66-a344d09f0d12 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:41.974516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30479d3-ae44-422c-9f66-a344d09f0d12 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:41.976682 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 137/267] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:41 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:41.981956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30479d3-ae44-422c-9f66-a344d09f0d12 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:41.998434 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd9a1e-e2c5-4cb5-9f13-1b64eb33fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:41.999101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9a1e-e2c5-4cb5-9f13-1b64eb33fd93 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:41.999381 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9a1e-e2c5-4cb5-9f13-1b64eb33fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:41.999658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd9a1e-e2c5-4cb5-9f13-1b64eb33fd93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:42.000498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd9a1e-e2c5-4cb5-9f13-1b64eb33fd93 None admin] RBAC: Adding query filter params (role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=e009c372f03c453eb347cdb038de6fab, user.id=9f6508cd39a14c3b955c2248899ab52f) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:42.000841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd9a1e-e2c5-4cb5-9f13-1b64eb33fd93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:42.002356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd9a1e-e2c5-4cb5-9f13-1b64eb33fd93 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:42.012788 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 131/268] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:41 2022] GET /identity/v3/role_assignments?user.id=9f6508cd39a14c3b955c2248899ab52f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:42.173296 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30479d3-ae44-422c-9f66-a344d09f0d12 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:42.216174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162351-feaf-48bd-8d59-8290226c353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:42.216890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162351-feaf-48bd-8d59-8290226c353e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:42.217169 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162351-feaf-48bd-8d59-8290226c353e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:42.217436 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162351-feaf-48bd-8d59-8290226c353e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:42.218293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162351-feaf-48bd-8d59-8290226c353e None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=e009c372f03c453eb347cdb038de6fab, user.id=9f6508cd39a14c3b955c2248899ab52f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:42.218594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162351-feaf-48bd-8d59-8290226c353e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:42.220123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162351-feaf-48bd-8d59-8290226c353e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:42.227265 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 138/269] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:41 2022] GET /identity/v3/role_assignments?user.id=9f6508cd39a14c3b955c2248899ab52f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=52bf3a299728408b8384e30e08547fd8 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:43.034034 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9edd-8d79-4ce5-85c2-6bd1cf2b64dd None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.034538 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9edd-8d79-4ce5-85c2-6bd1cf2b64dd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.034745 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9edd-8d79-4ce5-85c2-6bd1cf2b64dd None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.036303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 132/270] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:43.041930 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73fad-68d3-47dc-9951-ec6054eb1b3b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.042388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73fad-68d3-47dc-9951-ec6054eb1b3b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.042464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73fad-68d3-47dc-9951-ec6054eb1b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.060371 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1db73fad-68d3-47dc-9951-ec6054eb1b3b None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:43.061574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1db73fad-68d3-47dc-9951-ec6054eb1b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:43.132401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 139/271] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:43.155960 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce9edd-8d79-4ce5-85c2-6bd1cf2b64dd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:43.160813 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db9b51-1f1e-4b61-8dfd-be4dc9760363 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.161336 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db9b51-1f1e-4b61-8dfd-be4dc9760363 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.161840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db9b51-1f1e-4b61-8dfd-be4dc9760363 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.163388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 140/272] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:43.171232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f719-df07-4315-846a-6579b79584fa None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.171509 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f719-df07-4315-846a-6579b79584fa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.171781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f719-df07-4315-846a-6579b79584fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.195367 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f0c7f719-df07-4315-846a-6579b79584fa None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:43.196559 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f0c7f719-df07-4315-846a-6579b79584fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:43.265721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 141/273] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:43.272531 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce9edd-8d79-4ce5-85c2-6bd1cf2b64dd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:43.294238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f719-df07-4315-846a-6579b79584fa None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:43.318911 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459134f5-54c3-41e0-9f0e-d05d7342e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:43.320599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459134f5-54c3-41e0-9f0e-d05d7342e8bc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.321424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459134f5-54c3-41e0-9f0e-d05d7342e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.321904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459134f5-54c3-41e0-9f0e-d05d7342e8bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.337283 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459134f5-54c3-41e0-9f0e-d05d7342e8bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-459134f5-54c3-41e0-9f0e-d05d7342e8bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:43.349028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:43.349995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:43.350787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:43.353781 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 133/274] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:43.359977 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459134f5-54c3-41e0-9f0e-d05d7342e8bc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:43.424368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f719-df07-4315-846a-6579b79584fa None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:43.468493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5db6-26e6-449a-b8ac-fd9080c4ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:43.469498 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5db6-26e6-449a-b8ac-fd9080c4ba6d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.469877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5db6-26e6-449a-b8ac-fd9080c4ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.470309 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5db6-26e6-449a-b8ac-fd9080c4ba6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.473037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5db6-26e6-449a-b8ac-fd9080c4ba6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:43.475030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5db6-26e6-449a-b8ac-fd9080c4ba6d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:43.477586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 142/275] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:43.482826 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5db6-26e6-449a-b8ac-fd9080c4ba6d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:43.490504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459134f5-54c3-41e0-9f0e-d05d7342e8bc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:43.527451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e52722-e0cd-4b5e-ba1d-e619dc8ca38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:43.528524 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52722-e0cd-4b5e-ba1d-e619dc8ca38f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.529018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52722-e0cd-4b5e-ba1d-e619dc8ca38f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.529469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e52722-e0cd-4b5e-ba1d-e619dc8ca38f None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.530403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e52722-e0cd-4b5e-ba1d-e619dc8ca38f None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:43.530936 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e52722-e0cd-4b5e-ba1d-e619dc8ca38f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:43.532521 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e52722-e0cd-4b5e-ba1d-e619dc8ca38f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:43.545210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 134/276] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:43.548382 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955cea-9405-4081-a075-44f66c9f6e34 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.548665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955cea-9405-4081-a075-44f66c9f6e34 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.548981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955cea-9405-4081-a075-44f66c9f6e34 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.550906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 135/277] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:43.551629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae955cea-9405-4081-a075-44f66c9f6e34 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:43.592792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5db6-26e6-449a-b8ac-fd9080c4ba6d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:43.627463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5fde0-1ab9-4279-8d3c-241460511b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:43.628144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fde0-1ab9-4279-8d3c-241460511b14 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.629329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fde0-1ab9-4279-8d3c-241460511b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.629832 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fde0-1ab9-4279-8d3c-241460511b14 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.630623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5fde0-1ab9-4279-8d3c-241460511b14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:43.632092 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5fde0-1ab9-4279-8d3c-241460511b14 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:43.658016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 143/278] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:58:43 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:43.659227 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60cce-887b-4cfd-a956-990c7251be79 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.659637 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60cce-887b-4cfd-a956-990c7251be79 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.660160 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60cce-887b-4cfd-a956-990c7251be79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.682954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-92d60cce-887b-4cfd-a956-990c7251be79 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:43.684114 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-92d60cce-887b-4cfd-a956-990c7251be79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:43.691966 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae955cea-9405-4081-a075-44f66c9f6e34 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:43.752241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab2401-4472-4ffe-8339-83e3a1cef624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:43.753481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2401-4472-4ffe-8339-83e3a1cef624 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.754201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2401-4472-4ffe-8339-83e3a1cef624 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.754461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2401-4472-4ffe-8339-83e3a1cef624 None admin] PATH_INFO: `/v3/users/573289a5ef8f482f89423536ffe050cc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.777145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 144/279] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:43.780481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab2401-4472-4ffe-8339-83e3a1cef624 None admin] RBAC: Authorizing `identity:get_user(user_id=573289a5ef8f482f89423536ffe050cc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:43.782084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab2401-4472-4ffe-8339-83e3a1cef624 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:43.784025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 136/280] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:43 2022] GET /identity/v3/users/573289a5ef8f482f89423536ffe050cc => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:43.791031 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60cce-887b-4cfd-a956-990c7251be79 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:43.797187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab2401-4472-4ffe-8339-83e3a1cef624 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:43.914111 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab2401-4472-4ffe-8339-83e3a1cef624 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:43.926549 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60cce-887b-4cfd-a956-990c7251be79 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:43.951847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c288c58-0830-4b8e-abf4-42ba483deb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:43.952613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288c58-0830-4b8e-abf4-42ba483deb2b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.952879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288c58-0830-4b8e-abf4-42ba483deb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.953152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288c58-0830-4b8e-abf4-42ba483deb2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.964762 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c288c58-0830-4b8e-abf4-42ba483deb2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:43.966461 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:43.967202 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.967483 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.967760 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.968614 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] RBAC: Adding query filter params (role.id=8e27b8e86fc845e9b8569e559e21603f, user.id=573289a5ef8f482f89423536ffe050cc, scope.system=all) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:43.968958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:43.970433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7c288c58-0830-4b8e-abf4-42ba483deb2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:43.973307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:43.974186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:43.974967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:43.980170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 137/281] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:43.981590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47238f83-381a-4189-a8fe-1eec5d47a46b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.981590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47238f83-381a-4189-a8fe-1eec5d47a46b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:43.981590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47238f83-381a-4189-a8fe-1eec5d47a46b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:43.981835 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 145/282] 10.222.0.13 () {56 vars in 1308 bytes} [Mon May 16 13:58:43 2022] GET /identity/v3/role_assignments?user.id=573289a5ef8f482f89423536ffe050cc&scope.system=all&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:43.983130 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 138/283] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:43.983356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:43.998963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf6ff7-b09c-4485-be0c-c081d0382a70 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:43.999190 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf6ff7-b09c-4485-be0c-c081d0382a70 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:44.000401 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf6ff7-b09c-4485-be0c-c081d0382a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:44.034516 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dbdf6ff7-b09c-4485-be0c-c081d0382a70 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:44.038124 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dbdf6ff7-b09c-4485-be0c-c081d0382a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:44.119637 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c75e-12d8-4e30-9dcb-3f1edc61d981 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:44.171065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 139/284] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:44.183790 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:44.185587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:44.186409 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:44.187265 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:44.189177 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:44.190083 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:44.193602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:44.199359 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf6ff7-b09c-4485-be0c-c081d0382a70 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:44.211586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 146/285] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:44.219012 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:44.346587 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf6ff7-b09c-4485-be0c-c081d0382a70 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:44.437903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44b67-596f-432a-9228-c548015b7043 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:44.443259 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94179-3d73-49c5-9587-f2390eb02133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:44.444078 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94179-3d73-49c5-9587-f2390eb02133 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:44.444354 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94179-3d73-49c5-9587-f2390eb02133 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:44.444612 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94179-3d73-49c5-9587-f2390eb02133 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:44.466047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94179-3d73-49c5-9587-f2390eb02133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4ad94179-3d73-49c5-9587-f2390eb02133 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:44.474862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:44.476726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:44.478302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:44.485426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 140/286] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:44.491513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94179-3d73-49c5-9587-f2390eb02133 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:44.523464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e148-5a60-4df4-91cc-ac0cf7cfbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:44.524351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e148-5a60-4df4-91cc-ac0cf7cfbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:44.524627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e148-5a60-4df4-91cc-ac0cf7cfbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:44.524975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e148-5a60-4df4-91cc-ac0cf7cfbfa1 None admin] PATH_INFO: `/v3/users/a716343775ef42de98eded64008f628f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:44.526494 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728e148-5a60-4df4-91cc-ac0cf7cfbfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=a716343775ef42de98eded64008f628f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:44.528005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728e148-5a60-4df4-91cc-ac0cf7cfbfa1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:44.529945 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 147/287] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:44 2022] GET /identity/v3/users/a716343775ef42de98eded64008f628f => generated 297 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:44.537239 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e148-5a60-4df4-91cc-ac0cf7cfbfa1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:44.665229 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94179-3d73-49c5-9587-f2390eb02133 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:44.708996 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:44.709681 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:44.709958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:44.710226 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:44.710985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:44.711285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:44.712709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:44.730527 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 141/288] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:44.736858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:44.752629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e148-5a60-4df4-91cc-ac0cf7cfbfa1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:44.833127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a7f82-f53b-49ff-ba88-1039849ede8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:44.834805 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a7f82-f53b-49ff-ba88-1039849ede8a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:44.838353 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a7f82-f53b-49ff-ba88-1039849ede8a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:44.839205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a7f82-f53b-49ff-ba88-1039849ede8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:44.979626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fe24c-89b0-4fb2-a234-78be1061eb1d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:44.995002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a7f82-f53b-49ff-ba88-1039849ede8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:44.996422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a7f82-f53b-49ff-ba88-1039849ede8a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:45.030435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92778a2-80f4-47b9-aa66-91fd44c1232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:45.031331 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92778a2-80f4-47b9-aa66-91fd44c1232a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:45.031610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92778a2-80f4-47b9-aa66-91fd44c1232a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:45.031883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92778a2-80f4-47b9-aa66-91fd44c1232a None admin] PATH_INFO: `/v3/users/1cc6e5e1a63c4f8780704ac82265e7db` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:45.037495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92778a2-80f4-47b9-aa66-91fd44c1232a None admin] RBAC: Authorizing `identity:get_user(user_id=1cc6e5e1a63c4f8780704ac82265e7db)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:45.038955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92778a2-80f4-47b9-aa66-91fd44c1232a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:45.041065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 142/289] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:44 2022] GET /identity/v3/users/1cc6e5e1a63c4f8780704ac82265e7db => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:45.047663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92778a2-80f4-47b9-aa66-91fd44c1232a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:45.119197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 148/290] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:45.134175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a7f82-f53b-49ff-ba88-1039849ede8a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:45.182228 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92778a2-80f4-47b9-aa66-91fd44c1232a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:45.217462 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fd142-1324-4295-80b1-1055b756904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:45.218325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd142-1324-4295-80b1-1055b756904c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:45.218602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd142-1324-4295-80b1-1055b756904c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:45.218872 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd142-1324-4295-80b1-1055b756904c None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:45.223106 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fd142-1324-4295-80b1-1055b756904c None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:45.224638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fd142-1324-4295-80b1-1055b756904c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:45.226391 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 143/291] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:45 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:45.234360 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fd142-1324-4295-80b1-1055b756904c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:45.319127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a7f82-f53b-49ff-ba88-1039849ede8a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:45.402957 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf66a-32d2-4960-8baf-3d7c963d2337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:45.403331 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fd142-1324-4295-80b1-1055b756904c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:45.403828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf66a-32d2-4960-8baf-3d7c963d2337 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:45.404109 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf66a-32d2-4960-8baf-3d7c963d2337 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:45.404382 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf66a-32d2-4960-8baf-3d7c963d2337 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:45.409502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcf66a-32d2-4960-8baf-3d7c963d2337 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:45.412332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcf66a-32d2-4960-8baf-3d7c963d2337 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:45.414563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 149/292] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:45 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:45.431861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf66a-32d2-4960-8baf-3d7c963d2337 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:45.445295 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe83ed7-5d34-4523-a7f7-f616314628de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:45.446197 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83ed7-5d34-4523-a7f7-f616314628de None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:45.446477 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83ed7-5d34-4523-a7f7-f616314628de None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:45.446749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83ed7-5d34-4523-a7f7-f616314628de None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab/users/1cc6e5e1a63c4f8780704ac82265e7db/roles/2cb369a212074a9aae140dfa2d236368` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:45.448834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe83ed7-5d34-4523-a7f7-f616314628de None admin] RBAC: Authorizing `identity:create_grant(project_id=e009c372f03c453eb347cdb038de6fab, user_id=1cc6e5e1a63c4f8780704ac82265e7db, role_id=2cb369a212074a9aae140dfa2d236368)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:45.450295 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe83ed7-5d34-4523-a7f7-f616314628de None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:45.468105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 144/293] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:58:45 2022] PUT /identity/v3/projects/e009c372f03c453eb347cdb038de6fab/users/1cc6e5e1a63c4f8780704ac82265e7db/roles/2cb369a212074a9aae140dfa2d236368 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:45.589285 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf66a-32d2-4960-8baf-3d7c963d2337 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:45.677150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e54b7-36bf-4b29-ade5-d9543f20e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:45.678287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e54b7-36bf-4b29-ade5-d9543f20e062 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:45.678795 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e54b7-36bf-4b29-ade5-d9543f20e062 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:45.679293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e54b7-36bf-4b29-ade5-d9543f20e062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:45.685070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e54b7-36bf-4b29-ade5-d9543f20e062 None admin] RBAC: Adding query filter params (role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=e009c372f03c453eb347cdb038de6fab, user.id=a716343775ef42de98eded64008f628f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:45.685710 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e54b7-36bf-4b29-ade5-d9543f20e062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:45.688521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e54b7-36bf-4b29-ade5-d9543f20e062 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:45.705639 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 150/294] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:45 2022] GET /identity/v3/role_assignments?user.id=a716343775ef42de98eded64008f628f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:46.523431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3975-57af-445d-8c89-3b0584477161 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:46.523431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3975-57af-445d-8c89-3b0584477161 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:46.523431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3975-57af-445d-8c89-3b0584477161 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:46.523431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 145/295] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:46.530341 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4b1c-13b5-4c7b-aad9-c0e29af3dfba None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:46.531256 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4b1c-13b5-4c7b-aad9-c0e29af3dfba None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:46.531750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4b1c-13b5-4c7b-aad9-c0e29af3dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:46.549824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d24c4b1c-13b5-4c7b-aad9-c0e29af3dfba None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:46.552217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d24c4b1c-13b5-4c7b-aad9-c0e29af3dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:46.629948 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 151/296] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:46.653765 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3975-57af-445d-8c89-3b0584477161 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:46.768457 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3975-57af-445d-8c89-3b0584477161 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:46.809834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f497a-64b3-479c-a025-31971529b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:46.810565 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f497a-64b3-479c-a025-31971529b6db None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:46.810842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f497a-64b3-479c-a025-31971529b6db None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:46.811110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f497a-64b3-479c-a025-31971529b6db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:46.812345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f497a-64b3-479c-a025-31971529b6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:46.813853 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f497a-64b3-479c-a025-31971529b6db None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:46.816015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 146/297] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:46.821864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c4b1c-13b5-4c7b-aad9-c0e29af3dfba None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:46.930429 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c4b1c-13b5-4c7b-aad9-c0e29af3dfba None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:46.967120 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d4e51-f3e2-4507-8d30-ade33d0a5cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:46.967821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d4e51-f3e2-4507-8d30-ade33d0a5cd4 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:46.968092 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d4e51-f3e2-4507-8d30-ade33d0a5cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:46.968374 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d4e51-f3e2-4507-8d30-ade33d0a5cd4 None admin] PATH_INFO: `/v3/groups` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:46.969136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d4e51-f3e2-4507-8d30-ade33d0a5cd4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:46.970657 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d4e51-f3e2-4507-8d30-ade33d0a5cd4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:46.995954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 152/298] 10.222.0.13 () {60 vars in 1134 bytes} [Mon May 16 13:58:46 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 13:58:47.011208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be859-25fb-4fbd-b5e0-4699845bae61 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.011672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be859-25fb-4fbd-b5e0-4699845bae61 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.011826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be859-25fb-4fbd-b5e0-4699845bae61 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.015164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 147/299] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:47.020737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7f4d-6b49-413f-94a4-c47158a3faa9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.021019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7f4d-6b49-413f-94a4-c47158a3faa9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.021337 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7f4d-6b49-413f-94a4-c47158a3faa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.039506 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a21f7f4d-6b49-413f-94a4-c47158a3faa9 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:47.040775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a21f7f4d-6b49-413f-94a4-c47158a3faa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:47.123088 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 153/300] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:47.162805 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be859-25fb-4fbd-b5e0-4699845bae61 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:47.215214 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5c27-f2cd-4fcb-b280-ba5a27adb143 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.215546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5c27-f2cd-4fcb-b280-ba5a27adb143 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.215760 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5c27-f2cd-4fcb-b280-ba5a27adb143 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.217589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 154/301] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:47.224220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a695-2f18-4d32-b383-f33767ff0e0b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.224491 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a695-2f18-4d32-b383-f33767ff0e0b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.224803 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a695-2f18-4d32-b383-f33767ff0e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.245201 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1c04a695-2f18-4d32-b383-f33767ff0e0b None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:47.246803 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1c04a695-2f18-4d32-b383-f33767ff0e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:47.318490 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be859-25fb-4fbd-b5e0-4699845bae61 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:47.363542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 155/302] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:47.375749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54031cb-03f5-4f68-b9e0-dcc526b21243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:47.377511 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54031cb-03f5-4f68-b9e0-dcc526b21243 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.378314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54031cb-03f5-4f68-b9e0-dcc526b21243 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.379030 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54031cb-03f5-4f68-b9e0-dcc526b21243 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.385905 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a695-2f18-4d32-b383-f33767ff0e0b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:47.399208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54031cb-03f5-4f68-b9e0-dcc526b21243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a54031cb-03f5-4f68-b9e0-dcc526b21243 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:47.407484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:47.408578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:47.409420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:47.412505 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 148/303] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:47.418598 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54031cb-03f5-4f68-b9e0-dcc526b21243 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:47.547050 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54031cb-03f5-4f68-b9e0-dcc526b21243 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:47.568927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a695-2f18-4d32-b383-f33767ff0e0b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:47.585299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:47.586575 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.587022 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.587367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.588614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:47.588614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:47.590638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:47.606358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 149/304] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:47.608317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:47.629136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44105-fd9c-4c6b-bdb5-08a54fd4a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:47.630794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44105-fd9c-4c6b-bdb5-08a54fd4a808 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.631329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44105-fd9c-4c6b-bdb5-08a54fd4a808 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.631916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44105-fd9c-4c6b-bdb5-08a54fd4a808 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.648506 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44105-fd9c-4c6b-bdb5-08a54fd4a808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0bf44105-fd9c-4c6b-bdb5-08a54fd4a808 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:47.661775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:47.662821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:47.663781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:47.666849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 156/305] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:47.672642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44105-fd9c-4c6b-bdb5-08a54fd4a808 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:47.828029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44105-fd9c-4c6b-bdb5-08a54fd4a808 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:47.829827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994c33-7cda-40df-98f0-7f9cbfaba561 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:47.888035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623088-9c6a-4140-9999-baafbf0f893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:47.889401 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623088-9c6a-4140-9999-baafbf0f893f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.890007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623088-9c6a-4140-9999-baafbf0f893f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.890490 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623088-9c6a-4140-9999-baafbf0f893f None admin] PATH_INFO: `/v3/users/35fb75123fbd45d6bd0339989955cbe3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.909064 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:47.911024 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:47.911547 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:47.912099 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:47.914076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:47.915170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:47.916449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623088-9c6a-4140-9999-baafbf0f893f None admin] RBAC: Authorizing `identity:get_user(user_id=35fb75123fbd45d6bd0339989955cbe3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:47.918558 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:47.918751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623088-9c6a-4140-9999-baafbf0f893f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:47.921756 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 150/306] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:47 2022] GET /identity/v3/users/35fb75123fbd45d6bd0339989955cbe3 => generated 293 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:47.932431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623088-9c6a-4140-9999-baafbf0f893f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:47.935471 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 157/307] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:47.943376 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:48.077103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623088-9c6a-4140-9999-baafbf0f893f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:48.123454 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:48.124776 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:48.125264 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:48.125746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:48.127773 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] RBAC: Adding query filter params (role.id=2cb369a212074a9aae140dfa2d236368, user.id=35fb75123fbd45d6bd0339989955cbe3, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:48.129172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:48.131237 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:48.138678 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 151/308] 10.222.0.13 () {56 vars in 1308 bytes} [Mon May 16 13:58:47 2022] GET /identity/v3/role_assignments?user.id=35fb75123fbd45d6bd0339989955cbe3&scope.system=all&role.id=2cb369a212074a9aae140dfa2d236368 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:48.181093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54adb65-4540-48c3-ad82-e9a7a134f56f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:48.255798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329af765-54c9-40d7-8105-cdb57155581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:48.256867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af765-54c9-40d7-8105-cdb57155581a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:48.257158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af765-54c9-40d7-8105-cdb57155581a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:48.257437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af765-54c9-40d7-8105-cdb57155581a None admin] PATH_INFO: `/v3/users/573289a5ef8f482f89423536ffe050cc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:48.260946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329af765-54c9-40d7-8105-cdb57155581a None admin] RBAC: Authorizing `identity:get_user(user_id=573289a5ef8f482f89423536ffe050cc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:48.263010 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329af765-54c9-40d7-8105-cdb57155581a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:48.264980 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 158/309] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:47 2022] GET /identity/v3/users/573289a5ef8f482f89423536ffe050cc => generated 293 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:48.272338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:48.453897 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39cbc9-37e3-4a38-a89e-f0eeabfbcf00 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:48.506292 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd7313-1f6d-4cfe-b444-bb4262f67d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:48.507199 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd7313-1f6d-4cfe-b444-bb4262f67d7c None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:48.507479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd7313-1f6d-4cfe-b444-bb4262f67d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:48.507755 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd7313-1f6d-4cfe-b444-bb4262f67d7c None admin] PATH_INFO: `/v3/system/users/573289a5ef8f482f89423536ffe050cc/roles/8e27b8e86fc845e9b8569e559e21603f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:48.510130 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd7313-1f6d-4cfe-b444-bb4262f67d7c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=573289a5ef8f482f89423536ffe050cc, role_id=8e27b8e86fc845e9b8569e559e21603f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:48.512246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd7313-1f6d-4cfe-b444-bb4262f67d7c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:48.528927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 152/310] 10.222.0.13 () {58 vars in 1334 bytes} [Mon May 16 13:58:48 2022] PUT /identity/v3/system/users/573289a5ef8f482f89423536ffe050cc/roles/8e27b8e86fc845e9b8569e559e21603f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:48.739562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374e577-d2e5-4cd3-8845-53876f599cfe None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:48.740090 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374e577-d2e5-4cd3-8845-53876f599cfe None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:48.740384 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374e577-d2e5-4cd3-8845-53876f599cfe None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:48.743427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 159/311] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:48.752617 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7473034-62b7-4f15-a6b3-83bdfc390ae3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:48.753166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7473034-62b7-4f15-a6b3-83bdfc390ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:48.753622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7473034-62b7-4f15-a6b3-83bdfc390ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:48.783262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f7473034-62b7-4f15-a6b3-83bdfc390ae3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:48.785473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f7473034-62b7-4f15-a6b3-83bdfc390ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:48.862290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 153/312] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:48.885140 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374e577-d2e5-4cd3-8845-53876f599cfe None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:49.000455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374e577-d2e5-4cd3-8845-53876f599cfe None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:49.036827 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd76dc-10c1-414f-956c-83290d9ead2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:49.038005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd76dc-10c1-414f-956c-83290d9ead2a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:49.038480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd76dc-10c1-414f-956c-83290d9ead2a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:49.038960 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd76dc-10c1-414f-956c-83290d9ead2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:49.050098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd76dc-10c1-414f-956c-83290d9ead2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7ffd76dc-10c1-414f-956c-83290d9ead2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:49.061993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:49.062966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:49.063742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:49.067142 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 160/313] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:49.073807 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7473034-62b7-4f15-a6b3-83bdfc390ae3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:49.210779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7473034-62b7-4f15-a6b3-83bdfc390ae3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:49.257041 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:49.257642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:49.257926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:49.258201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:49.258959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:49.259263 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:49.260656 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:49.271215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 154/314] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:49.279873 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd76dc-10c1-414f-956c-83290d9ead2a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:49.397617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd76dc-10c1-414f-956c-83290d9ead2a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:49.434691 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26644574-36f5-4926-a70d-1fcc10c6cc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:49.435579 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26644574-36f5-4926-a70d-1fcc10c6cc18 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:49.435862 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26644574-36f5-4926-a70d-1fcc10c6cc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:49.436166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26644574-36f5-4926-a70d-1fcc10c6cc18 None admin] PATH_INFO: `/v3/users/1cc6e5e1a63c4f8780704ac82265e7db` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:49.437389 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26644574-36f5-4926-a70d-1fcc10c6cc18 None admin] RBAC: Authorizing `identity:get_user(user_id=1cc6e5e1a63c4f8780704ac82265e7db)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:49.438835 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26644574-36f5-4926-a70d-1fcc10c6cc18 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:49.440824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 161/315] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:49 2022] GET /identity/v3/users/1cc6e5e1a63c4f8780704ac82265e7db => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:49.449052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:49.565350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49c20a-3b68-4b8b-bd07-a8cc01bd27c0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:49.604383 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f57f-6a2a-4259-8dcd-5b1a6ce4249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:49.605073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f57f-6a2a-4259-8dcd-5b1a6ce4249b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:49.605356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f57f-6a2a-4259-8dcd-5b1a6ce4249b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:49.605634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f57f-6a2a-4259-8dcd-5b1a6ce4249b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:49.679085 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f57f-6a2a-4259-8dcd-5b1a6ce4249b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:49.680996 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f57f-6a2a-4259-8dcd-5b1a6ce4249b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:49.789269 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 155/316] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 13:58:49.795005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26644574-36f5-4926-a70d-1fcc10c6cc18 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:49.906002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26644574-36f5-4926-a70d-1fcc10c6cc18 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:49.943258 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb0428-8d5e-4a99-b6d1-1a4d9e8a85be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:49.944133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb0428-8d5e-4a99-b6d1-1a4d9e8a85be None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:49.944414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb0428-8d5e-4a99-b6d1-1a4d9e8a85be None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:49.944708 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb0428-8d5e-4a99-b6d1-1a4d9e8a85be None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:49.945928 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb0428-8d5e-4a99-b6d1-1a4d9e8a85be None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:49.949568 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb0428-8d5e-4a99-b6d1-1a4d9e8a85be None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:49.949568 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 162/317] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:49 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:49.955162 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f57f-6a2a-4259-8dcd-5b1a6ce4249b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:50.064055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f57f-6a2a-4259-8dcd-5b1a6ce4249b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:50.102623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba8bcb-c926-47a4-a510-d9e87950c0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:50.103297 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8bcb-c926-47a4-a510-d9e87950c0dd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:50.103566 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8bcb-c926-47a4-a510-d9e87950c0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:50.103836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8bcb-c926-47a4-a510-d9e87950c0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:50.104695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8bcb-c926-47a4-a510-d9e87950c0dd None admin] RBAC: Adding query filter params (role.id=2cb369a212074a9aae140dfa2d236368, scope.project.id=e009c372f03c453eb347cdb038de6fab, user.id=1cc6e5e1a63c4f8780704ac82265e7db) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:50.105020 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8bcb-c926-47a4-a510-d9e87950c0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:50.106467 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8bcb-c926-47a4-a510-d9e87950c0dd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:50.113982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 156/318] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:58:49 2022] GET /identity/v3/role_assignments?user.id=1cc6e5e1a63c4f8780704ac82265e7db&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=2cb369a212074a9aae140dfa2d236368 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:50.340010 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66f14-67a7-4bfa-a835-20c45d74408e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:50.340501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66f14-67a7-4bfa-a835-20c45d74408e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:50.340976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66f14-67a7-4bfa-a835-20c45d74408e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:50.343863 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 163/319] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:50.354110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa387b-710a-4d8f-a695-6a761546be7c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:50.354601 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa387b-710a-4d8f-a695-6a761546be7c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:50.355080 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa387b-710a-4d8f-a695-6a761546be7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:50.382940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-befa387b-710a-4d8f-a695-6a761546be7c None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:50.384940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-befa387b-710a-4d8f-a695-6a761546be7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:50.497281 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 157/320] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:50.536792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf66f14-67a7-4bfa-a835-20c45d74408e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:50.708031 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf66f14-67a7-4bfa-a835-20c45d74408e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:50.767392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045454e-d636-4064-8cb7-e68fdd39a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:50.768783 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045454e-d636-4064-8cb7-e68fdd39a791 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:50.770255 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045454e-d636-4064-8cb7-e68fdd39a791 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:50.770730 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045454e-d636-4064-8cb7-e68fdd39a791 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:50.772763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045454e-d636-4064-8cb7-e68fdd39a791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:50.775413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045454e-d636-4064-8cb7-e68fdd39a791 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:50.778387 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 164/321] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:50.785475 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa387b-710a-4d8f-a695-6a761546be7c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:50.923820 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591fecb-e750-454b-98f1-605d4c1ef167 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:50.924600 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591fecb-e750-454b-98f1-605d4c1ef167 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:50.924600 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591fecb-e750-454b-98f1-605d4c1ef167 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:50.927294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 165/322] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:50.932843 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ba15-2082-4a4c-9438-7d4c6036b580 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:50.933139 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ba15-2082-4a4c-9438-7d4c6036b580 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:50.933427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ba15-2082-4a4c-9438-7d4c6036b580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:50.938783 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa387b-710a-4d8f-a695-6a761546be7c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:50.960956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7b03ba15-2082-4a4c-9438-7d4c6036b580 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:50.963281 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7b03ba15-2082-4a4c-9438-7d4c6036b580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:50.975815 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369d3fe-a662-486b-8968-0a69b8fcbed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:50.976498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369d3fe-a662-486b-8968-0a69b8fcbed8 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:50.976810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369d3fe-a662-486b-8968-0a69b8fcbed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:50.977090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369d3fe-a662-486b-8968-0a69b8fcbed8 None admin] PATH_INFO: `/v3/groups` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:50.978376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369d3fe-a662-486b-8968-0a69b8fcbed8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:50.979827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369d3fe-a662-486b-8968-0a69b8fcbed8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:51.002268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 158/323] 10.222.0.13 () {60 vars in 1134 bytes} [Mon May 16 13:58:50 2022] POST /identity/v3/groups => generated 226 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:58:51.058639 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 166/324] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:58:51.083818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369d3fe-a662-486b-8968-0a69b8fcbed8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:51.210949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369d3fe-a662-486b-8968-0a69b8fcbed8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:51.257669 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0106a6-6048-48b0-a6f4-21431004a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:51.258973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0106a6-6048-48b0-a6f4-21431004a476 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:51.259445 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0106a6-6048-48b0-a6f4-21431004a476 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:51.259906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0106a6-6048-48b0-a6f4-21431004a476 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:51.275974 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0106a6-6048-48b0-a6f4-21431004a476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-be0106a6-6048-48b0-a6f4-21431004a476 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:51.283914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:51.285599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:51.286660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 159/325] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:51.294332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ba15-2082-4a4c-9438-7d4c6036b580 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:51.447146 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ba15-2082-4a4c-9438-7d4c6036b580 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:51.515649 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:51.516832 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:51.517329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:51.517825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:51.519424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:51.519955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:51.522414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:51.539211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 167/326] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:51.545722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0106a6-6048-48b0-a6f4-21431004a476 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:51.757551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0106a6-6048-48b0-a6f4-21431004a476 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:51.824534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ee879-b2ac-44dd-afb3-552ef9c5fc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:51.826097 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee879-b2ac-44dd-afb3-552ef9c5fc44 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:51.826600 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee879-b2ac-44dd-afb3-552ef9c5fc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:51.827179 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee879-b2ac-44dd-afb3-552ef9c5fc44 None admin] PATH_INFO: `/v3/users/35fb75123fbd45d6bd0339989955cbe3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:51.829670 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ee879-b2ac-44dd-afb3-552ef9c5fc44 None admin] RBAC: Authorizing `identity:get_user(user_id=35fb75123fbd45d6bd0339989955cbe3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:51.833473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ee879-b2ac-44dd-afb3-552ef9c5fc44 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:51.836801 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 160/327] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:51 2022] GET /identity/v3/users/35fb75123fbd45d6bd0339989955cbe3 => generated 293 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:51.845789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:51.991861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40adab-f70b-4327-a2cc-1a730bd5c256 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:52.038073 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de88ee-83c6-446e-b0ed-9e5b2412e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:52.038965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de88ee-83c6-446e-b0ed-9e5b2412e3ec None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:52.039247 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de88ee-83c6-446e-b0ed-9e5b2412e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:52.039521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de88ee-83c6-446e-b0ed-9e5b2412e3ec None admin] PATH_INFO: `/v3/system/users/35fb75123fbd45d6bd0339989955cbe3/roles/2cb369a212074a9aae140dfa2d236368` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:52.042542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de88ee-83c6-446e-b0ed-9e5b2412e3ec None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=35fb75123fbd45d6bd0339989955cbe3, role_id=2cb369a212074a9aae140dfa2d236368)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:52.043956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de88ee-83c6-446e-b0ed-9e5b2412e3ec None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:52.071182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 168/328] 10.222.0.13 () {58 vars in 1334 bytes} [Mon May 16 13:58:51 2022] PUT /identity/v3/system/users/35fb75123fbd45d6bd0339989955cbe3/roles/2cb369a212074a9aae140dfa2d236368 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:58:52.239941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02468c-3de0-4279-a31f-f980751d8d94 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:52.241573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02468c-3de0-4279-a31f-f980751d8d94 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:52.242398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02468c-3de0-4279-a31f-f980751d8d94 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:52.245908 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 161/329] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:52.255303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d75c7-669c-4e5d-bdbf-b9abe98ac4d3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:52.255697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d75c7-669c-4e5d-bdbf-b9abe98ac4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:52.255929 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d75c7-669c-4e5d-bdbf-b9abe98ac4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:52.287130 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4f8d75c7-669c-4e5d-bdbf-b9abe98ac4d3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:52.288401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4f8d75c7-669c-4e5d-bdbf-b9abe98ac4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:52.395916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 169/330] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:52.472746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02468c-3de0-4279-a31f-f980751d8d94 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:52.689483 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02468c-3de0-4279-a31f-f980751d8d94 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:52.732547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a9455-4c6f-4292-ab2a-d1d3b0d780e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:52.733414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9455-4c6f-4292-ab2a-d1d3b0d780e0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:52.733748 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9455-4c6f-4292-ab2a-d1d3b0d780e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:52.733986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9455-4c6f-4292-ab2a-d1d3b0d780e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:52.754158 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a9455-4c6f-4292-ab2a-d1d3b0d780e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3f9a9455-4c6f-4292-ab2a-d1d3b0d780e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:52.762254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:52.763970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:52.765607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 162/331] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:52.772834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d75c7-669c-4e5d-bdbf-b9abe98ac4d3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:52.908286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d75c7-669c-4e5d-bdbf-b9abe98ac4d3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:52.956393 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:52.958063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:52.958407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:52.958738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:52.959527 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:52.959831 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:52.961291 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:52.975377 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 170/332] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:52.985146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a9455-4c6f-4292-ab2a-d1d3b0d780e0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:53.111377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a9455-4c6f-4292-ab2a-d1d3b0d780e0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:53.151536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94320d9-4ce1-4525-acf3-1392e4c1a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:53.152435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94320d9-4ce1-4525-acf3-1392e4c1a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:53.152738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94320d9-4ce1-4525-acf3-1392e4c1a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:53.153017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94320d9-4ce1-4525-acf3-1392e4c1a9c3 None admin] PATH_INFO: `/v3/users/573289a5ef8f482f89423536ffe050cc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:53.156288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94320d9-4ce1-4525-acf3-1392e4c1a9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=573289a5ef8f482f89423536ffe050cc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:53.157864 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94320d9-4ce1-4525-acf3-1392e4c1a9c3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:53.160412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 163/333] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:52 2022] GET /identity/v3/users/573289a5ef8f482f89423536ffe050cc => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:53.169332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:53.305115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1fa0a-f704-4c53-9262-6c8740ca75ff None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:53.352515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e2dfc-202f-4618-9afd-33463edc3f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:53.353578 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2dfc-202f-4618-9afd-33463edc3f0f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:53.353862 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2dfc-202f-4618-9afd-33463edc3f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:53.354183 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2dfc-202f-4618-9afd-33463edc3f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:53.355078 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e2dfc-202f-4618-9afd-33463edc3f0f None admin] RBAC: Adding query filter params (role.id=8e27b8e86fc845e9b8569e559e21603f, user.id=573289a5ef8f482f89423536ffe050cc, scope.system=all) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:53.355392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e2dfc-202f-4618-9afd-33463edc3f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:53.356943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e2dfc-202f-4618-9afd-33463edc3f0f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:53.375348 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 171/334] 10.222.0.13 () {56 vars in 1308 bytes} [Mon May 16 13:58:53 2022] GET /identity/v3/role_assignments?user.id=573289a5ef8f482f89423536ffe050cc&scope.system=all&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:53.876125 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7115a5-508c-46e4-a1e6-4be71042c068 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:53.876813 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7115a5-508c-46e4-a1e6-4be71042c068 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:53.876813 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7115a5-508c-46e4-a1e6-4be71042c068 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:53.879070 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 164/335] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:53.887375 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c1c9-31bb-4c5e-bf54-1bdf7debd400 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:53.887758 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c1c9-31bb-4c5e-bf54-1bdf7debd400 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:53.887989 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c1c9-31bb-4c5e-bf54-1bdf7debd400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:53.910877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0c92c1c9-31bb-4c5e-bf54-1bdf7debd400 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:53.912123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0c92c1c9-31bb-4c5e-bf54-1bdf7debd400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:53.991955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 172/336] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:54.033413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7115a5-508c-46e4-a1e6-4be71042c068 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:54.152554 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7115a5-508c-46e4-a1e6-4be71042c068 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:54.197217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f2b6-1c9c-45cd-9382-783d9a028f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:54.198079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f2b6-1c9c-45cd-9382-783d9a028f91 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:54.198358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f2b6-1c9c-45cd-9382-783d9a028f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:54.198630 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f2b6-1c9c-45cd-9382-783d9a028f91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:54.212245 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5f2b6-1c9c-45cd-9382-783d9a028f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-01e5f2b6-1c9c-45cd-9382-783d9a028f91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:54.225492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:54.226904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:54.228450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 165/337] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:54.232839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92c1c9-31bb-4c5e-bf54-1bdf7debd400 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:54.361812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92c1c9-31bb-4c5e-bf54-1bdf7debd400 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:54.407260 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:54.408236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:54.408685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:54.409127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:54.411055 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:54.411524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:54.413903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:54.427840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 173/338] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:54.434227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f2b6-1c9c-45cd-9382-783d9a028f91 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:54.635882 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f2b6-1c9c-45cd-9382-783d9a028f91 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:54.679641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1071d-7c4a-4108-a844-f285a758833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:54.680233 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1071d-7c4a-4108-a844-f285a758833b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:54.680515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1071d-7c4a-4108-a844-f285a758833b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:54.680820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1071d-7c4a-4108-a844-f285a758833b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:54.774530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1071d-7c4a-4108-a844-f285a758833b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:54.777131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1071d-7c4a-4108-a844-f285a758833b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:54.918335 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 166/339] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:54.923987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:55.066519 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc40db-a2b3-4508-8c75-66f5c2bafa63 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:55.106795 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06c936-9c20-4ea7-89ed-2cad82dfc61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:55.107676 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c936-9c20-4ea7-89ed-2cad82dfc61b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:55.107952 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c936-9c20-4ea7-89ed-2cad82dfc61b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:55.108230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c936-9c20-4ea7-89ed-2cad82dfc61b None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:55.109483 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06c936-9c20-4ea7-89ed-2cad82dfc61b None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:55.110920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06c936-9c20-4ea7-89ed-2cad82dfc61b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:55.113160 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 174/340] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:54 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:55.118845 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1071d-7c4a-4108-a844-f285a758833b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:55.252995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1071d-7c4a-4108-a844-f285a758833b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:55.290190 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e045da1-03ba-429b-8e47-1e5d5d4b1628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:55.291055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e045da1-03ba-429b-8e47-1e5d5d4b1628 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:55.291336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e045da1-03ba-429b-8e47-1e5d5d4b1628 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:55.291604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e045da1-03ba-429b-8e47-1e5d5d4b1628 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:55.303238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e045da1-03ba-429b-8e47-1e5d5d4b1628 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:55.304723 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e045da1-03ba-429b-8e47-1e5d5d4b1628 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:55.306437 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 167/341] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:58:55 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:55.312187 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06c936-9c20-4ea7-89ed-2cad82dfc61b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:55.524763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06c936-9c20-4ea7-89ed-2cad82dfc61b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:55.575567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801089f2-03ab-4212-8c67-3c361106970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:55.576251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801089f2-03ab-4212-8c67-3c361106970b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:55.576529 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801089f2-03ab-4212-8c67-3c361106970b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:55.576826 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801089f2-03ab-4212-8c67-3c361106970b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:55.577823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801089f2-03ab-4212-8c67-3c361106970b None admin] RBAC: Adding query filter params (group.id=92371f6261d44d70b728753adb15a62f, role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:55.578127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801089f2-03ab-4212-8c67-3c361106970b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:55.579589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801089f2-03ab-4212-8c67-3c361106970b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:55.588211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 175/342] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:58:55 2022] GET /identity/v3/role_assignments?group.id=92371f6261d44d70b728753adb15a62f&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:55.645484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9307d-ef01-4959-a36a-fcba58b8b170 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:55.646020 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9307d-ef01-4959-a36a-fcba58b8b170 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:55.646463 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9307d-ef01-4959-a36a-fcba58b8b170 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:55.648439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 168/343] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:55.661656 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407014cf-d33d-4be2-abf9-010c1ea26467 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:55.661987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407014cf-d33d-4be2-abf9-010c1ea26467 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:55.662208 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407014cf-d33d-4be2-abf9-010c1ea26467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:55.689722 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-407014cf-d33d-4be2-abf9-010c1ea26467 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:55.690973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-407014cf-d33d-4be2-abf9-010c1ea26467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:55.764891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 176/344] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:55.816959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9307d-ef01-4959-a36a-fcba58b8b170 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:55.958562 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9307d-ef01-4959-a36a-fcba58b8b170 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:56.005485 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d0dff-7c51-43f9-b7d4-9a10dffb9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:56.006296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0dff-7c51-43f9-b7d4-9a10dffb9b70 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.006570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0dff-7c51-43f9-b7d4-9a10dffb9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.006843 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0dff-7c51-43f9-b7d4-9a10dffb9b70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.019136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d0dff-7c51-43f9-b7d4-9a10dffb9b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-479d0dff-7c51-43f9-b7d4-9a10dffb9b70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:56.027940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:56.028993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:56.029832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:56.032724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 169/345] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:58:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:56.039014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407014cf-d33d-4be2-abf9-010c1ea26467 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:56.156232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407014cf-d33d-4be2-abf9-010c1ea26467 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:56.194151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:56.195171 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.195674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.196134 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.197141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:56.197637 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:56.199276 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:56.209110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 177/346] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:58:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:58:56.214333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d0dff-7c51-43f9-b7d4-9a10dffb9b70 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:56.325380 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d0dff-7c51-43f9-b7d4-9a10dffb9b70 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:56.361289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46112134-1233-4339-8513-9e3e00e31b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:56.362312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46112134-1233-4339-8513-9e3e00e31b29 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.363404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46112134-1233-4339-8513-9e3e00e31b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.364059 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46112134-1233-4339-8513-9e3e00e31b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.450383 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46112134-1233-4339-8513-9e3e00e31b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:56.452282 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46112134-1233-4339-8513-9e3e00e31b29 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:56.580893 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 170/347] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:56.588016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:56.590418 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f4d22-e025-4325-86fc-a80fe7faf977 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.590702 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f4d22-e025-4325-86fc-a80fe7faf977 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.590982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f4d22-e025-4325-86fc-a80fe7faf977 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.592696 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 171/348] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:56.597611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d28e-b44a-44b3-852b-3db765698795 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.597950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d28e-b44a-44b3-852b-3db765698795 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.598210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d28e-b44a-44b3-852b-3db765698795 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.599944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 172/349] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:58:56.601544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072cab8-d7fd-44c2-830a-5784f2e67bfe None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.601544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072cab8-d7fd-44c2-830a-5784f2e67bfe None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.601751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072cab8-d7fd-44c2-830a-5784f2e67bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.635214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0072cab8-d7fd-44c2-830a-5784f2e67bfe None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:56.636439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0072cab8-d7fd-44c2-830a-5784f2e67bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:56.718187 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4896b28-37e2-4f76-a807-a57deea0e9b5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:56.764880 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 173/350] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:56.766765 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ba39-45f9-4b93-96c1-741e1f207bb6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.767278 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ba39-45f9-4b93-96c1-741e1f207bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.767944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ba39-45f9-4b93-96c1-741e1f207bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.769284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0657-b0c5-479b-8784-78375491ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:56.770499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0657-b0c5-479b-8784-78375491ad1b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.770855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0657-b0c5-479b-8784-78375491ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.771195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0657-b0c5-479b-8784-78375491ad1b None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.772717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b0657-b0c5-479b-8784-78375491ad1b None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:56.774428 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b0657-b0c5-479b-8784-78375491ad1b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:56.777625 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 178/351] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:56 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:56.789549 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ade8ba39-45f9-4b93-96c1-741e1f207bb6 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:56.790005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0657-b0c5-479b-8784-78375491ad1b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:56.791317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ade8ba39-45f9-4b93-96c1-741e1f207bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:56.875368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 174/352] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:56.876589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8ba39-45f9-4b93-96c1-741e1f207bb6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:56.938141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0657-b0c5-479b-8784-78375491ad1b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:56.987038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c92a5-f877-4878-90bd-476b75cbf198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:56.988943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c92a5-f877-4878-90bd-476b75cbf198 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:56.989418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c92a5-f877-4878-90bd-476b75cbf198 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:56.989901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c92a5-f877-4878-90bd-476b75cbf198 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:56.991429 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c92a5-f877-4878-90bd-476b75cbf198 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:56.993155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c92a5-f877-4878-90bd-476b75cbf198 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:56.995230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 179/353] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:58:56 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:56.996354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c92a5-f877-4878-90bd-476b75cbf198 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:57.030980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8ba39-45f9-4b93-96c1-741e1f207bb6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:57.068054 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bde17-eafd-4134-b5ef-ed9ee69d25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:57.069130 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bde17-eafd-4134-b5ef-ed9ee69d25e4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.069547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bde17-eafd-4134-b5ef-ed9ee69d25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.069983 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bde17-eafd-4134-b5ef-ed9ee69d25e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.081001 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bde17-eafd-4134-b5ef-ed9ee69d25e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d90bde17-eafd-4134-b5ef-ed9ee69d25e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:57.089610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:57.090749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:57.091728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:57.093746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 175/354] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:57.094728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bde17-eafd-4134-b5ef-ed9ee69d25e4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:57.108102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c92a5-f877-4878-90bd-476b75cbf198 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:57.155198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79db8c-0f23-4a81-89a4-a76ef7725e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:57.156466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79db8c-0f23-4a81-89a4-a76ef7725e4f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.156924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79db8c-0f23-4a81-89a4-a76ef7725e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.157363 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79db8c-0f23-4a81-89a4-a76ef7725e4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.182090 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79db8c-0f23-4a81-89a4-a76ef7725e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5f79db8c-0f23-4a81-89a4-a76ef7725e4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:57.194303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:57.195453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:58:57.196286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:57.202501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 180/355] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:58:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:57.205150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79db8c-0f23-4a81-89a4-a76ef7725e4f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:57.274975 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bde17-eafd-4134-b5ef-ed9ee69d25e4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:57.322595 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:57.324070 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.324942 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.324942 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.325520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] RBAC: Adding query filter params (group.id=92371f6261d44d70b728753adb15a62f, role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:57.325838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:57.327310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:57.334842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 176/356] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:58:57 2022] GET /identity/v3/role_assignments?group.id=92371f6261d44d70b728753adb15a62f&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:57.336010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:57.368047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79db8c-0f23-4a81-89a4-a76ef7725e4f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:57.409297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df272ce-0cc0-4cee-88e3-aa40709d1691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:57.410352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df272ce-0cc0-4cee-88e3-aa40709d1691 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.410801 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df272ce-0cc0-4cee-88e3-aa40709d1691 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.411220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df272ce-0cc0-4cee-88e3-aa40709d1691 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.412145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df272ce-0cc0-4cee-88e3-aa40709d1691 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:57.412616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df272ce-0cc0-4cee-88e3-aa40709d1691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:57.414242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df272ce-0cc0-4cee-88e3-aa40709d1691 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:57.424032 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 181/357] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:57.425857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50ff8-3dcf-4860-ad32-ed7fe373d7ab None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.426308 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50ff8-3dcf-4860-ad32-ed7fe373d7ab None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.426731 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50ff8-3dcf-4860-ad32-ed7fe373d7ab None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.428965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 182/358] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:57.430551 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea601c2-42b3-46b2-b9b4-25d777d6ef87 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.430988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea601c2-42b3-46b2-b9b4-25d777d6ef87 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.431405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea601c2-42b3-46b2-b9b4-25d777d6ef87 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.433125 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 183/359] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:57.434130 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea601c2-42b3-46b2-b9b4-25d777d6ef87 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:57.462518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1594d4-0579-4165-969d-41d43b2effa0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:57.503964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39464b-9ace-487c-a7c1-b9fb960a3552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:57.504990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39464b-9ace-487c-a7c1-b9fb960a3552 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.505507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39464b-9ace-487c-a7c1-b9fb960a3552 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.506145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39464b-9ace-487c-a7c1-b9fb960a3552 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.507153 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39464b-9ace-487c-a7c1-b9fb960a3552 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:57.507738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39464b-9ace-487c-a7c1-b9fb960a3552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:57.510885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39464b-9ace-487c-a7c1-b9fb960a3552 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:57.524251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 177/360] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:57.527109 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351df9-52b7-449a-b939-cbfe95e04cb1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.527933 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351df9-52b7-449a-b939-cbfe95e04cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.528697 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351df9-52b7-449a-b939-cbfe95e04cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.551774 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cf351df9-52b7-449a-b939-cbfe95e04cb1 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:57.553936 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cf351df9-52b7-449a-b939-cbfe95e04cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:57.561662 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea601c2-42b3-46b2-b9b4-25d777d6ef87 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:57.607984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a3ef9-c3b0-4e8a-89b0-8cdf28348c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:57.609657 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a3ef9-c3b0-4e8a-89b0-8cdf28348c7e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.610010 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a3ef9-c3b0-4e8a-89b0-8cdf28348c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.610292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a3ef9-c3b0-4e8a-89b0-8cdf28348c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.662340 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 178/361] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:57.664520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d274-5d1b-4f11-ba3b-50460df50076 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.664832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d274-5d1b-4f11-ba3b-50460df50076 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.665316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621d274-5d1b-4f11-ba3b-50460df50076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.687573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1621d274-5d1b-4f11-ba3b-50460df50076 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:57.689825 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1621d274-5d1b-4f11-ba3b-50460df50076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:57.717566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a3ef9-c3b0-4e8a-89b0-8cdf28348c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:57.719276 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a3ef9-c3b0-4e8a-89b0-8cdf28348c7e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:57.775471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 179/362] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:57.776862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621d274-5d1b-4f11-ba3b-50460df50076 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:57.833115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 184/363] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:57.834457 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a3ef9-c3b0-4e8a-89b0-8cdf28348c7e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:57.883403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621d274-5d1b-4f11-ba3b-50460df50076 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:57.922551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062f39f-19ec-45e2-8e3a-2485f44de5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:57.923647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f39f-19ec-45e2-8e3a-2485f44de5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:57.924135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f39f-19ec-45e2-8e3a-2485f44de5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:57.924610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f39f-19ec-45e2-8e3a-2485f44de5e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:57.967095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a3ef9-c3b0-4e8a-89b0-8cdf28348c7e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.008545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92ec1-9e6c-49bf-be37-11e16bf703c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.009417 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92ec1-9e6c-49bf-be37-11e16bf703c3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.009744 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92ec1-9e6c-49bf-be37-11e16bf703c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.010018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92ec1-9e6c-49bf-be37-11e16bf703c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.010781 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062f39f-19ec-45e2-8e3a-2485f44de5e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:58.012496 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062f39f-19ec-45e2-8e3a-2485f44de5e2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:58.023791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a92ec1-9e6c-49bf-be37-11e16bf703c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-71a92ec1-9e6c-49bf-be37-11e16bf703c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:58.031942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:58.032962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 185/364] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:58.034364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92ec1-9e6c-49bf-be37-11e16bf703c3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.143634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 180/365] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:58.145659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062f39f-19ec-45e2-8e3a-2485f44de5e2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.178457 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92ec1-9e6c-49bf-be37-11e16bf703c3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.218862 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1010-4fac-42f8-bac3-4a1fbc17f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.219666 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1010-4fac-42f8-bac3-4a1fbc17f722 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.219952 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1010-4fac-42f8-bac3-4a1fbc17f722 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.220231 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1010-4fac-42f8-bac3-4a1fbc17f722 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.232356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1010-4fac-42f8-bac3-4a1fbc17f722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-058e1010-4fac-42f8-bac3-4a1fbc17f722 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:58.241020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:58.241988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:58:58.242782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:58:58.248624 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 186/366] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:58:58.249861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1010-4fac-42f8-bac3-4a1fbc17f722 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.274413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062f39f-19ec-45e2-8e3a-2485f44de5e2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.322008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101d9b-e36b-4ae1-83c8-c343c89d38c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.322884 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101d9b-e36b-4ae1-83c8-c343c89d38c7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.323164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101d9b-e36b-4ae1-83c8-c343c89d38c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.323435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101d9b-e36b-4ae1-83c8-c343c89d38c7 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.326205 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf101d9b-e36b-4ae1-83c8-c343c89d38c7 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:58.327668 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf101d9b-e36b-4ae1-83c8-c343c89d38c7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:58.329599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 181/367] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:58.330427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101d9b-e36b-4ae1-83c8-c343c89d38c7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.373430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1010-4fac-42f8-bac3-4a1fbc17f722 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.412477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.413114 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.413399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.413676 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.414433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:58.414737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:58.416316 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:58.428863 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 187/368] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:58.430273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.463858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101d9b-e36b-4ae1-83c8-c343c89d38c7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.511097 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880aba-e22a-4e8a-9eee-d1e4668ce8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.512416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880aba-e22a-4e8a-9eee-d1e4668ce8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.512973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880aba-e22a-4e8a-9eee-d1e4668ce8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.513460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880aba-e22a-4e8a-9eee-d1e4668ce8a0 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.514867 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880aba-e22a-4e8a-9eee-d1e4668ce8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:58.516505 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880aba-e22a-4e8a-9eee-d1e4668ce8a0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:58.518820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 182/369] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:58.520338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880aba-e22a-4e8a-9eee-d1e4668ce8a0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.570636 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3d72e-670c-4f85-a2ea-6c687bae8cfd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.613480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.614659 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.614946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.615226 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.616272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:58.616585 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:58.618165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:58.630399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 188/370] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:58.631399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.636069 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880aba-e22a-4e8a-9eee-d1e4668ce8a0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.672447 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f05d68-0a69-409a-92b0-664ac657ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.673693 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f05d68-0a69-409a-92b0-664ac657ba1d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.674248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f05d68-0a69-409a-92b0-664ac657ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.674730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f05d68-0a69-409a-92b0-664ac657ba1d None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.677227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f05d68-0a69-409a-92b0-664ac657ba1d None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:58.678946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f05d68-0a69-409a-92b0-664ac657ba1d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:58.680800 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 183/371] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:58.681858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f05d68-0a69-409a-92b0-664ac657ba1d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.766284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef33c4-bf69-47d9-a269-7b034f91c6a4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.807429 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429de3c9-52f4-46fb-9342-90b1086d34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.808647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429de3c9-52f4-46fb-9342-90b1086d34f8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.809172 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429de3c9-52f4-46fb-9342-90b1086d34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.809665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429de3c9-52f4-46fb-9342-90b1086d34f8 None admin] PATH_INFO: `/v3/users/35fb75123fbd45d6bd0339989955cbe3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.811077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429de3c9-52f4-46fb-9342-90b1086d34f8 None admin] RBAC: Authorizing `identity:get_user(user_id=35fb75123fbd45d6bd0339989955cbe3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:58.812859 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429de3c9-52f4-46fb-9342-90b1086d34f8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:58.814462 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f05d68-0a69-409a-92b0-664ac657ba1d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.814949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 189/372] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/users/35fb75123fbd45d6bd0339989955cbe3 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:58.816122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429de3c9-52f4-46fb-9342-90b1086d34f8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.858790 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa865-d974-4ee1-8acf-afc2a3ed0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.859660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa865-d974-4ee1-8acf-afc2a3ed0c3a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.859941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa865-d974-4ee1-8acf-afc2a3ed0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.860215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa865-d974-4ee1-8acf-afc2a3ed0c3a None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:58.861435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8aa865-d974-4ee1-8acf-afc2a3ed0c3a None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:58.862914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8aa865-d974-4ee1-8acf-afc2a3ed0c3a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:58.868699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 184/373] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:58.868699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa865-d974-4ee1-8acf-afc2a3ed0c3a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:58.949034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429de3c9-52f4-46fb-9342-90b1086d34f8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:58.989404 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bb69f-e811-41dd-afd4-9d2871f52c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:58.990461 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bb69f-e811-41dd-afd4-9d2871f52c44 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:58.990461 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bb69f-e811-41dd-afd4-9d2871f52c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:58.990461 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bb69f-e811-41dd-afd4-9d2871f52c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.011363 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa865-d974-4ee1-8acf-afc2a3ed0c3a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:59.055837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:59.056530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.056833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.057104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.058361 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] RBAC: Adding query filter params (group.id=92371f6261d44d70b728753adb15a62f, role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=e009c372f03c453eb347cdb038de6fab) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:59.058361 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:59.059642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:59.068404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 185/374] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/role_assignments?group.id=92371f6261d44d70b728753adb15a62f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:59.069095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:59.090857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bb69f-e811-41dd-afd4-9d2871f52c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:59.092732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bb69f-e811-41dd-afd4-9d2871f52c44 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:59.218755 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d403f-b886-404f-b27d-82d25306ba60 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:59.230477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 190/375] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:58:59.232408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bb69f-e811-41dd-afd4-9d2871f52c44 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:59.268283 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82084d37-0c26-4651-af56-b72168f9800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:59.269582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82084d37-0c26-4651-af56-b72168f9800c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.270519 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82084d37-0c26-4651-af56-b72168f9800c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.271312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82084d37-0c26-4651-af56-b72168f9800c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.272436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82084d37-0c26-4651-af56-b72168f9800c None admin] RBAC: Adding query filter params (role.id=2cb369a212074a9aae140dfa2d236368, user.id=35fb75123fbd45d6bd0339989955cbe3, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:59.272997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82084d37-0c26-4651-af56-b72168f9800c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:59.275769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82084d37-0c26-4651-af56-b72168f9800c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:59.292233 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 186/376] 10.222.0.13 () {56 vars in 1308 bytes} [Mon May 16 13:58:59 2022] GET /identity/v3/role_assignments?user.id=35fb75123fbd45d6bd0339989955cbe3&scope.system=all&role.id=2cb369a212074a9aae140dfa2d236368 => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:59.294683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e320a94-724a-457f-ab04-785d2f7f11e0 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.295332 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e320a94-724a-457f-ab04-785d2f7f11e0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.295820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e320a94-724a-457f-ab04-785d2f7f11e0 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.298727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 187/377] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:58:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:58:59.299939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e320a94-724a-457f-ab04-785d2f7f11e0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:59.365839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bb69f-e811-41dd-afd4-9d2871f52c44 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:59.414085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b2d5-855c-42ab-8bc0-483f332f3488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:59.414814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b2d5-855c-42ab-8bc0-483f332f3488 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.415097 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b2d5-855c-42ab-8bc0-483f332f3488 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.415369 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b2d5-855c-42ab-8bc0-483f332f3488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.416216 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646b2d5-855c-42ab-8bc0-483f332f3488 None admin] RBAC: Adding query filter params (group.id=92371f6261d44d70b728753adb15a62f, role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=e009c372f03c453eb347cdb038de6fab) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:59.416521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646b2d5-855c-42ab-8bc0-483f332f3488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:59.418881 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646b2d5-855c-42ab-8bc0-483f332f3488 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:59.436834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 191/378] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:58:59 2022] GET /identity/v3/role_assignments?group.id=92371f6261d44d70b728753adb15a62f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:59.438686 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858c0c3-d087-4c23-86ab-c65b86461c1f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.439174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858c0c3-d087-4c23-86ab-c65b86461c1f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.439669 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858c0c3-d087-4c23-86ab-c65b86461c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.451393 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e320a94-724a-457f-ab04-785d2f7f11e0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:59.466775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5858c0c3-d087-4c23-86ab-c65b86461c1f None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:58:59.468324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5858c0c3-d087-4c23-86ab-c65b86461c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:58:59.499629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54815a4-55b9-4680-96b9-5f5a387c1dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:59.500621 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54815a4-55b9-4680-96b9-5f5a387c1dfa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.500997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54815a4-55b9-4680-96b9-5f5a387c1dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.501277 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54815a4-55b9-4680-96b9-5f5a387c1dfa None admin] PATH_INFO: `/v3/projects/4548a84ff35448d493ae9458aa7d0261` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.502703 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54815a4-55b9-4680-96b9-5f5a387c1dfa None admin] RBAC: Authorizing `identity:get_project(project_id=4548a84ff35448d493ae9458aa7d0261)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:59.505015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54815a4-55b9-4680-96b9-5f5a387c1dfa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:59.507423 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 188/379] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:58:59 2022] GET /identity/v3/projects/4548a84ff35448d493ae9458aa7d0261 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:59.513350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54815a4-55b9-4680-96b9-5f5a387c1dfa None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:59.638585 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54815a4-55b9-4680-96b9-5f5a387c1dfa None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:59.663358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 192/380] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:58:59.692550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a4130-a4ed-4a05-8e58-a0ad71578bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:59.693544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4130-a4ed-4a05-8e58-a0ad71578bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.693822 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4130-a4ed-4a05-8e58-a0ad71578bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.694092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4130-a4ed-4a05-8e58-a0ad71578bf6 None admin] PATH_INFO: `/v3/groups/7856461cead549ee94422357f1f647de` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.699884 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4130-a4ed-4a05-8e58-a0ad71578bf6 None admin] RBAC: Authorizing `identity:get_group(group_id=7856461cead549ee94422357f1f647de)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:59.701423 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4130-a4ed-4a05-8e58-a0ad71578bf6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:59.703627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 189/381] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:58:59 2022] GET /identity/v3/groups/7856461cead549ee94422357f1f647de => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:59.709930 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858c0c3-d087-4c23-86ab-c65b86461c1f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:59.723617 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a4130-a4ed-4a05-8e58-a0ad71578bf6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:58:59.879564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858c0c3-d087-4c23-86ab-c65b86461c1f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:59.899374 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a4130-a4ed-4a05-8e58-a0ad71578bf6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:58:59.952707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:59.952707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.952707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.952707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.953126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] RBAC: Adding query filter params (group.id=7856461cead549ee94422357f1f647de, role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=4548a84ff35448d493ae9458aa7d0261) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:58:59.953126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:58:59.953126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:58:59.964585 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01a097-7549-4510-aa21-a2f46235901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:58:59.965478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a097-7549-4510-aa21-a2f46235901e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:58:59.965769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a097-7549-4510-aa21-a2f46235901e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:58:59.966045 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a097-7549-4510-aa21-a2f46235901e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:58:59.966942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 193/382] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:58:59 2022] GET /identity/v3/role_assignments?group.id=7856461cead549ee94422357f1f647de&scope.project.id=4548a84ff35448d493ae9458aa7d0261&role.id=52bf3a299728408b8384e30e08547fd8 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:58:59.979715 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01a097-7549-4510-aa21-a2f46235901e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3f01a097-7549-4510-aa21-a2f46235901e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:58:59.987726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:58:59.990161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:58:59.992503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 190/383] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:58:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:58:59.998045 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:00.117669 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7690b-4a62-4173-b88a-261858f1243c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:00.159030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:00.159628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:00.159979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:00.160472 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:00.162672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184f45c-ae2c-446f-95c9-949ea638382f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:00.162952 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184f45c-ae2c-446f-95c9-949ea638382f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:00.163226 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184f45c-ae2c-446f-95c9-949ea638382f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:00.164754 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 191/384] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:59:00.164971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:00.165287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:00.166683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:00.173037 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07438-4dae-44d5-8858-4f6def564417 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:00.173505 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07438-4dae-44d5-8858-4f6def564417 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:00.174003 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07438-4dae-44d5-8858-4f6def564417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:00.184640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 194/385] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:58:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:00.205099 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:00.215307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a2b07438-4dae-44d5-8858-4f6def564417 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:00.218116 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a2b07438-4dae-44d5-8858-4f6def564417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:00.364570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865a6ef-becb-4c81-b565-2748b012a0e5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:00.391145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 192/386] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:00.401327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f1f15-fbc4-425c-b558-82ccc28a12e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:00.402233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1f15-fbc4-425c-b558-82ccc28a12e3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:00.402513 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1f15-fbc4-425c-b558-82ccc28a12e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:00.402784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1f15-fbc4-425c-b558-82ccc28a12e3 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:00.403981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f1f15-fbc4-425c-b558-82ccc28a12e3 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:00.405464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f1f15-fbc4-425c-b558-82ccc28a12e3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:00.407104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 195/387] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:00 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:00.412998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b07438-4dae-44d5-8858-4f6def564417 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:00.421551 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f1f15-fbc4-425c-b558-82ccc28a12e3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:00.592955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b07438-4dae-44d5-8858-4f6def564417 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:00.621382 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f1f15-fbc4-425c-b558-82ccc28a12e3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:00.670032 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72905ea8-be61-4d82-b708-45c1546035bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:00.670991 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72905ea8-be61-4d82-b708-45c1546035bc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:00.671370 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72905ea8-be61-4d82-b708-45c1546035bc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:00.671644 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72905ea8-be61-4d82-b708-45c1546035bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:00.676504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100f12c-d996-4486-be0d-41b320a70292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:00.677426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f12c-d996-4486-be0d-41b320a70292 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:00.677918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f12c-d996-4486-be0d-41b320a70292 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:00.678322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f12c-d996-4486-be0d-41b320a70292 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:00.681145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100f12c-d996-4486-be0d-41b320a70292 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:00.683030 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100f12c-d996-4486-be0d-41b320a70292 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:00.684658 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72905ea8-be61-4d82-b708-45c1546035bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:00.689581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 193/388] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:00 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:00.692151 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100f12c-d996-4486-be0d-41b320a70292 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-72905ea8-be61-4d82-b708-45c1546035bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:00.693774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:00.694672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:00.695456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:00.696052 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 196/389] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:59:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:00.707822 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72905ea8-be61-4d82-b708-45c1546035bc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:00.880582 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72905ea8-be61-4d82-b708-45c1546035bc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:00.904614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100f12c-d996-4486-be0d-41b320a70292 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:00.916113 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:00.916824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:00.917117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:00.917394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:00.918153 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:00.918459 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:00.919838 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:00.931796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 197/390] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:00.937486 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:00.981422 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7e79e-6f73-41bc-9c09-f60fbbf19acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:00.982345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7e79e-6f73-41bc-9c09-f60fbbf19acd None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:00.982620 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7e79e-6f73-41bc-9c09-f60fbbf19acd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:00.982906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7e79e-6f73-41bc-9c09-f60fbbf19acd None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/groups/92371f6261d44d70b728753adb15a62f/roles/8e27b8e86fc845e9b8569e559e21603f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:00.988707 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7e79e-6f73-41bc-9c09-f60fbbf19acd None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b0c2761cb4387b2427fcd3c01356c, group_id=92371f6261d44d70b728753adb15a62f, role_id=8e27b8e86fc845e9b8569e559e21603f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:00.990312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7e79e-6f73-41bc-9c09-f60fbbf19acd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:01.018950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 194/391] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 13:59:00 2022] PUT /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/groups/92371f6261d44d70b728753adb15a62f/roles/8e27b8e86fc845e9b8569e559e21603f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 13:59:01.068868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83658d2-96dd-4da5-9717-b812581b5594 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:01.109469 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5691af-31a3-4523-ac11-7a42d9b8ee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:01.110418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5691af-31a3-4523-ac11-7a42d9b8ee78 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:01.110705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5691af-31a3-4523-ac11-7a42d9b8ee78 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:01.110982 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5691af-31a3-4523-ac11-7a42d9b8ee78 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:01.112277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5691af-31a3-4523-ac11-7a42d9b8ee78 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:01.114444 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5691af-31a3-4523-ac11-7a42d9b8ee78 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:01.116743 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 198/392] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:00 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:01.123090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7e79e-6f73-41bc-9c09-f60fbbf19acd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:01.279450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7e79e-6f73-41bc-9c09-f60fbbf19acd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:01.318958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247a5f9-1030-49c8-a628-81850da1773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:01.319891 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247a5f9-1030-49c8-a628-81850da1773d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:01.320174 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247a5f9-1030-49c8-a628-81850da1773d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:01.320498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247a5f9-1030-49c8-a628-81850da1773d None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:01.325670 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247a5f9-1030-49c8-a628-81850da1773d None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:01.327254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247a5f9-1030-49c8-a628-81850da1773d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:01.329630 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 195/393] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:01 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:01.336438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5691af-31a3-4523-ac11-7a42d9b8ee78 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:01.457418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5691af-31a3-4523-ac11-7a42d9b8ee78 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:01.502776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0329f4-bf87-4cc3-a4ba-08072d1cfbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:01.503738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0329f4-bf87-4cc3-a4ba-08072d1cfbd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:01.504016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0329f4-bf87-4cc3-a4ba-08072d1cfbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:01.504321 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0329f4-bf87-4cc3-a4ba-08072d1cfbd1 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/groups/92371f6261d44d70b728753adb15a62f/roles/b38b04aec27e41b9a8c2824918eedd12` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:01.507749 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0329f4-bf87-4cc3-a4ba-08072d1cfbd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b0c2761cb4387b2427fcd3c01356c, group_id=92371f6261d44d70b728753adb15a62f, role_id=b38b04aec27e41b9a8c2824918eedd12)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:01.509265 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0329f4-bf87-4cc3-a4ba-08072d1cfbd1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:01.533251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 199/394] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 13:59:01 2022] PUT /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c/groups/92371f6261d44d70b728753adb15a62f/roles/b38b04aec27e41b9a8c2824918eedd12 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:59:02.349478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fa40a-7d5e-403e-b097-1e28f6511d77 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:02.349997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fa40a-7d5e-403e-b097-1e28f6511d77 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:02.350099 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fa40a-7d5e-403e-b097-1e28f6511d77 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:02.351797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 196/395] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:02.362288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86a4b7-b4d3-43de-b115-1d7cbae3cf4d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:02.362768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86a4b7-b4d3-43de-b115-1d7cbae3cf4d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:02.362840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86a4b7-b4d3-43de-b115-1d7cbae3cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:02.381782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9b86a4b7-b4d3-43de-b115-1d7cbae3cf4d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:02.382975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9b86a4b7-b4d3-43de-b115-1d7cbae3cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:02.456619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c027d-5052-4c3b-b1d0-6d44c79dfc01 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:02.457594 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c027d-5052-4c3b-b1d0-6d44c79dfc01 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:02.457722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c027d-5052-4c3b-b1d0-6d44c79dfc01 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:02.459127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 200/396] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:02.459321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 197/397] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:02.482745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ebac-00a6-4753-a3f3-2f1092916df3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:02.483054 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ebac-00a6-4753-a3f3-2f1092916df3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:02.483282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ebac-00a6-4753-a3f3-2f1092916df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:02.485947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c027d-5052-4c3b-b1d0-6d44c79dfc01 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:02.505088 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8846ebac-00a6-4753-a3f3-2f1092916df3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:02.506757 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8846ebac-00a6-4753-a3f3-2f1092916df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:02.609993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 201/398] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:02.641249 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ebac-00a6-4753-a3f3-2f1092916df3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:02.711025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c027d-5052-4c3b-b1d0-6d44c79dfc01 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:02.791225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94d30-a963-480f-8de9-9f52751a304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:02.792038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94d30-a963-480f-8de9-9f52751a304c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:02.792487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94d30-a963-480f-8de9-9f52751a304c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:02.795095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ebac-00a6-4753-a3f3-2f1092916df3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:02.797003 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94d30-a963-480f-8de9-9f52751a304c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:02.825682 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94d30-a963-480f-8de9-9f52751a304c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-08d94d30-a963-480f-8de9-9f52751a304c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:02.834847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:02.835779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:59:02.836569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:02.839401 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 198/399] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:02.843141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7f19-6626-4187-96df-e914aebcba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:02.844265 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7f19-6626-4187-96df-e914aebcba50 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:02.844805 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7f19-6626-4187-96df-e914aebcba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:02.845293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7f19-6626-4187-96df-e914aebcba50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:02.846935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94d30-a963-480f-8de9-9f52751a304c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:02.871132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef7f19-6626-4187-96df-e914aebcba50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-87ef7f19-6626-4187-96df-e914aebcba50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:02.880178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:02.881118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:02.881924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:02.884646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 202/400] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:59:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:02.891340 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7f19-6626-4187-96df-e914aebcba50 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:03.067293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7f19-6626-4187-96df-e914aebcba50 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.102952 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94d30-a963-480f-8de9-9f52751a304c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.110723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.111720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.112228 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.112718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.113720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:03.114236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:03.115848 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:03.125336 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 203/401] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:03.131436 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:03.176087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.177238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.177535 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.177814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.178590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:03.178898 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:03.180288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:03.194981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 199/402] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:03.200597 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:03.248310 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07266c08-a4e4-4087-92e6-d707a4e1cc31 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.294251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b19417-b376-42ea-82b6-36b9cd8344c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.295116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b19417-b376-42ea-82b6-36b9cd8344c3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.295394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b19417-b376-42ea-82b6-36b9cd8344c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.295670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b19417-b376-42ea-82b6-36b9cd8344c3 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.297000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b19417-b376-42ea-82b6-36b9cd8344c3 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:03.299944 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b19417-b376-42ea-82b6-36b9cd8344c3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:03.300068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 204/403] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:03 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:03.303364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304d9e-7c60-4b71-840f-d75baae9ede9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.304419 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304d9e-7c60-4b71-840f-d75baae9ede9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.304705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304d9e-7c60-4b71-840f-d75baae9ede9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.310493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 205/404] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:03.311237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304d9e-7c60-4b71-840f-d75baae9ede9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:03.369335 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5e37b-555f-45dd-9e4a-53c6199bcd45 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.407395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb12edf-85d4-4475-a8a9-ff180f644768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.408239 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12edf-85d4-4475-a8a9-ff180f644768 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.408523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12edf-85d4-4475-a8a9-ff180f644768 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.408829 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12edf-85d4-4475-a8a9-ff180f644768 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.410899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb12edf-85d4-4475-a8a9-ff180f644768 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:03.412113 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb12edf-85d4-4475-a8a9-ff180f644768 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:03.413812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 200/405] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:03 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:03.415007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717e87-41c1-48c5-aa1a-8ff3fcde7be5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.415289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717e87-41c1-48c5-aa1a-8ff3fcde7be5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.415562 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717e87-41c1-48c5-aa1a-8ff3fcde7be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.433683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5e717e87-41c1-48c5-aa1a-8ff3fcde7be5 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:03.434951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5e717e87-41c1-48c5-aa1a-8ff3fcde7be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:03.441913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304d9e-7c60-4b71-840f-d75baae9ede9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.482352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c445d-692c-4842-b70e-a164fbc9ba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.483608 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c445d-692c-4842-b70e-a164fbc9ba76 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.484123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c445d-692c-4842-b70e-a164fbc9ba76 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.484594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c445d-692c-4842-b70e-a164fbc9ba76 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.486144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c445d-692c-4842-b70e-a164fbc9ba76 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:03.487889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c445d-692c-4842-b70e-a164fbc9ba76 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:03.491358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 206/406] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:03 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:03.492542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c445d-692c-4842-b70e-a164fbc9ba76 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:03.511216 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 201/407] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:03.511920 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e717e87-41c1-48c5-aa1a-8ff3fcde7be5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:03.609330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c445d-692c-4842-b70e-a164fbc9ba76 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.617885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e717e87-41c1-48c5-aa1a-8ff3fcde7be5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.647566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755348a-c746-4166-9429-4f3d42439d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.648846 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755348a-c746-4166-9429-4f3d42439d2b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.649364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755348a-c746-4166-9429-4f3d42439d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.649866 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755348a-c746-4166-9429-4f3d42439d2b None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.651494 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755348a-c746-4166-9429-4f3d42439d2b None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:03.653670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755348a-c746-4166-9429-4f3d42439d2b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:03.655157 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e93b16-da35-44b1-9201-bccae81aa911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.656061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e93b16-da35-44b1-9201-bccae81aa911 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.656445 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e93b16-da35-44b1-9201-bccae81aa911 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.656622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e93b16-da35-44b1-9201-bccae81aa911 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab/groups/92371f6261d44d70b728753adb15a62f/roles/b38b04aec27e41b9a8c2824918eedd12` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.657234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 207/408] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:03 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:03.658609 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755348a-c746-4166-9429-4f3d42439d2b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:03.659327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e93b16-da35-44b1-9201-bccae81aa911 None admin] RBAC: Authorizing `identity:create_grant(project_id=e009c372f03c453eb347cdb038de6fab, group_id=92371f6261d44d70b728753adb15a62f, role_id=b38b04aec27e41b9a8c2824918eedd12)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:03.661736 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e93b16-da35-44b1-9201-bccae81aa911 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:03.681175 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 202/409] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 13:59:03 2022] PUT /identity/v3/projects/e009c372f03c453eb347cdb038de6fab/groups/92371f6261d44d70b728753adb15a62f/roles/b38b04aec27e41b9a8c2824918eedd12 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:59:03.682445 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e93b16-da35-44b1-9201-bccae81aa911 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:03.796309 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755348a-c746-4166-9429-4f3d42439d2b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.806256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e93b16-da35-44b1-9201-bccae81aa911 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:03.853015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be921044-c60e-4f0e-bd0c-079f5bb135fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.855224 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be921044-c60e-4f0e-bd0c-079f5bb135fc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.856134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7468e-40f5-4b2b-bed6-876eac16de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:03.856689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be921044-c60e-4f0e-bd0c-079f5bb135fc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.857847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7468e-40f5-4b2b-bed6-876eac16de08 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:03.858375 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be921044-c60e-4f0e-bd0c-079f5bb135fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.859615 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7468e-40f5-4b2b-bed6-876eac16de08 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:03.861131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7468e-40f5-4b2b-bed6-876eac16de08 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab/groups/92371f6261d44d70b728753adb15a62f/roles/8e27b8e86fc845e9b8569e559e21603f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:03.868731 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7468e-40f5-4b2b-bed6-876eac16de08 None admin] RBAC: Authorizing `identity:create_grant(project_id=e009c372f03c453eb347cdb038de6fab, group_id=92371f6261d44d70b728753adb15a62f, role_id=8e27b8e86fc845e9b8569e559e21603f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:03.868731 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7468e-40f5-4b2b-bed6-876eac16de08 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:03.882195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be921044-c60e-4f0e-bd0c-079f5bb135fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-be921044-c60e-4f0e-bd0c-079f5bb135fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:03.892016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:03.893117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:03.894037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:03.895803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 203/410] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 13:59:03 2022] PUT /identity/v3/projects/e009c372f03c453eb347cdb038de6fab/groups/92371f6261d44d70b728753adb15a62f/roles/8e27b8e86fc845e9b8569e559e21603f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:59:03.897923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 208/411] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:03.904969 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7468e-40f5-4b2b-bed6-876eac16de08 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:04.037738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7468e-40f5-4b2b-bed6-876eac16de08 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:04.078573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:04.079272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:04.079553 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:04.079828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:04.080601 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:04.080936 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:04.082890 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:04.092862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 204/412] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:04.099242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be921044-c60e-4f0e-bd0c-079f5bb135fc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:04.229646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be921044-c60e-4f0e-bd0c-079f5bb135fc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:04.272003 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e3dd-a64e-4b4f-8583-30a885d44bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:04.273306 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e3dd-a64e-4b4f-8583-30a885d44bee None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:04.273816 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e3dd-a64e-4b4f-8583-30a885d44bee None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:04.274350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e3dd-a64e-4b4f-8583-30a885d44bee None admin] PATH_INFO: `/v3/groups/7856461cead549ee94422357f1f647de` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:04.275892 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e3dd-a64e-4b4f-8583-30a885d44bee None admin] RBAC: Authorizing `identity:get_group(group_id=7856461cead549ee94422357f1f647de)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:04.277713 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e3dd-a64e-4b4f-8583-30a885d44bee None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:04.280135 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 209/413] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:04 2022] GET /identity/v3/groups/7856461cead549ee94422357f1f647de => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:04.286225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:04.395782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c4694-73d7-4b21-b218-af753b0776b2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:04.436236 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc9362-3330-4329-95a0-927c76ce0001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:04.437166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc9362-3330-4329-95a0-927c76ce0001 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:04.437444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc9362-3330-4329-95a0-927c76ce0001 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:04.437713 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc9362-3330-4329-95a0-927c76ce0001 None admin] PATH_INFO: `/v3/projects/4548a84ff35448d493ae9458aa7d0261` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:04.438961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc9362-3330-4329-95a0-927c76ce0001 None admin] RBAC: Authorizing `identity:get_project(project_id=4548a84ff35448d493ae9458aa7d0261)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:04.440409 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc9362-3330-4329-95a0-927c76ce0001 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:04.442530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 205/414] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:04 2022] GET /identity/v3/projects/4548a84ff35448d493ae9458aa7d0261 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:04.448633 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e3dd-a64e-4b4f-8583-30a885d44bee None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:04.579298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2b3d3-2e10-4bbb-b246-1bfb48a18f4a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:04.579793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2b3d3-2e10-4bbb-b246-1bfb48a18f4a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:04.580195 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2b3d3-2e10-4bbb-b246-1bfb48a18f4a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:04.582489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 206/415] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:04.587964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf990-cc39-4382-b92e-494b2f8978ee None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:04.588356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf990-cc39-4382-b92e-494b2f8978ee None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:04.588771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf990-cc39-4382-b92e-494b2f8978ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:04.606574 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ceedf990-cc39-4382-b92e-494b2f8978ee None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:04.607917 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ceedf990-cc39-4382-b92e-494b2f8978ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:04.652935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e3dd-a64e-4b4f-8583-30a885d44bee None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:04.681365 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 207/416] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:04.704624 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedf990-cc39-4382-b92e-494b2f8978ee None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:04.772459 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701294b-e680-4886-9d67-de3ae67bdfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:04.774439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701294b-e680-4886-9d67-de3ae67bdfd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:04.775156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701294b-e680-4886-9d67-de3ae67bdfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:04.775876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701294b-e680-4886-9d67-de3ae67bdfd5 None admin] PATH_INFO: `/v3/projects/4548a84ff35448d493ae9458aa7d0261/groups/7856461cead549ee94422357f1f647de/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:04.779665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701294b-e680-4886-9d67-de3ae67bdfd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4548a84ff35448d493ae9458aa7d0261, group_id=7856461cead549ee94422357f1f647de, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:04.791067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701294b-e680-4886-9d67-de3ae67bdfd5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:04.809285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedf990-cc39-4382-b92e-494b2f8978ee None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:04.838792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 210/417] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 13:59:04 2022] PUT /identity/v3/projects/4548a84ff35448d493ae9458aa7d0261/groups/7856461cead549ee94422357f1f647de/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:59:04.849483 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16663f0-9879-4cbd-b76a-e25522b3e176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:04.850504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16663f0-9879-4cbd-b76a-e25522b3e176 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:04.850888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16663f0-9879-4cbd-b76a-e25522b3e176 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:04.851167 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16663f0-9879-4cbd-b76a-e25522b3e176 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:04.864246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16663f0-9879-4cbd-b76a-e25522b3e176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c16663f0-9879-4cbd-b76a-e25522b3e176 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:04.872464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:04.874547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:04.877211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 208/418] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:04.886406 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701294b-e680-4886-9d67-de3ae67bdfd5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:05.094698 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701294b-e680-4886-9d67-de3ae67bdfd5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:05.139785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50135310-22ae-4095-9485-e7f461ee250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:05.140888 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50135310-22ae-4095-9485-e7f461ee250d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:05.141380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50135310-22ae-4095-9485-e7f461ee250d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:05.141853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50135310-22ae-4095-9485-e7f461ee250d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:05.142842 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50135310-22ae-4095-9485-e7f461ee250d None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:05.143365 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50135310-22ae-4095-9485-e7f461ee250d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:05.145691 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50135310-22ae-4095-9485-e7f461ee250d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:05.155365 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 211/419] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:59:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:05.161423 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16663f0-9879-4cbd-b76a-e25522b3e176 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:05.190275 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6fdf3-1d13-4e42-abd0-7f8f6d007039 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:05.190783 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6fdf3-1d13-4e42-abd0-7f8f6d007039 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:05.191804 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6fdf3-1d13-4e42-abd0-7f8f6d007039 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:05.194993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 212/420] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:05.204308 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4c90-a868-475b-8c7c-f77232f93938 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:05.204866 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4c90-a868-475b-8c7c-f77232f93938 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:05.205405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4c90-a868-475b-8c7c-f77232f93938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:05.233699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-690a4c90-a868-475b-8c7c-f77232f93938 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:05.235640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-690a4c90-a868-475b-8c7c-f77232f93938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:05.349615 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 213/421] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:05.358606 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16663f0-9879-4cbd-b76a-e25522b3e176 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:05.417949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5c2d7-e89e-4787-943b-6762461a3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:05.418981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c2d7-e89e-4787-943b-6762461a3347 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:05.419484 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c2d7-e89e-4787-943b-6762461a3347 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:05.419986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c2d7-e89e-4787-943b-6762461a3347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:05.448116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a4c90-a868-475b-8c7c-f77232f93938 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:05.577837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5c2d7-e89e-4787-943b-6762461a3347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:05.579328 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5c2d7-e89e-4787-943b-6762461a3347 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:05.661373 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a4c90-a868-475b-8c7c-f77232f93938 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:05.741282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ba30a-f331-420a-bb13-d665f0dded60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:05.742600 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba30a-f331-420a-bb13-d665f0dded60 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:05.743090 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba30a-f331-420a-bb13-d665f0dded60 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:05.743563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba30a-f331-420a-bb13-d665f0dded60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:05.758974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ba30a-f331-420a-bb13-d665f0dded60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-884ba30a-f331-420a-bb13-d665f0dded60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:05.768112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:05.770548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:05.775442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 214/422] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:59:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:05.787266 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ba30a-f331-420a-bb13-d665f0dded60 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:05.897487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ba30a-f331-420a-bb13-d665f0dded60 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:05.925044 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 209/423] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:05.935071 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5c2d7-e89e-4787-943b-6762461a3347 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:05.962056 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:05.962769 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:05.963035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:05.963310 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:05.964263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:05.964814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:05.966867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:05.996590 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 215/424] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:06.005036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:06.091862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5c2d7-e89e-4787-943b-6762461a3347 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:06.150250 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59ec0-54cc-4214-851a-de31d1955d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:06.151751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59ec0-54cc-4214-851a-de31d1955d19 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:06.152194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59ec0-54cc-4214-851a-de31d1955d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:06.152633 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59ec0-54cc-4214-851a-de31d1955d19 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:06.160554 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c59ec0-54cc-4214-851a-de31d1955d19 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:06.163321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c59ec0-54cc-4214-851a-de31d1955d19 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:06.166533 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 210/425] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:05 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:06.172266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59ec0-54cc-4214-851a-de31d1955d19 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:06.257729 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c4d8c-7b76-455b-8351-074a4acf573a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:06.341718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bb6c2-868f-4243-bcf4-04e1a5693f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:06.342555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb6c2-868f-4243-bcf4-04e1a5693f6d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:06.342836 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb6c2-868f-4243-bcf4-04e1a5693f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:06.343107 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb6c2-868f-4243-bcf4-04e1a5693f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:06.416846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59ec0-54cc-4214-851a-de31d1955d19 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:06.459313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bb6c2-868f-4243-bcf4-04e1a5693f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:06.460812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bb6c2-868f-4243-bcf4-04e1a5693f6d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:06.461747 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7ffb-2d22-4013-b015-b5b17d8d3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:06.462625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7ffb-2d22-4013-b015-b5b17d8d3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:06.462899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7ffb-2d22-4013-b015-b5b17d8d3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:06.463167 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7ffb-2d22-4013-b015-b5b17d8d3cb2 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:06.469542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e7ffb-2d22-4013-b015-b5b17d8d3cb2 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:06.471018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e7ffb-2d22-4013-b015-b5b17d8d3cb2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:06.474010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 211/426] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:06 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:06.479826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7ffb-2d22-4013-b015-b5b17d8d3cb2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:06.568035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 216/427] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:06.570030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834c1de-ec33-4713-8404-e498c9b8f25b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:06.570312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834c1de-ec33-4713-8404-e498c9b8f25b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:06.570386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834c1de-ec33-4713-8404-e498c9b8f25b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:06.571888 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 217/428] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:06.576916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834c1de-ec33-4713-8404-e498c9b8f25b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:06.595948 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7ffb-2d22-4013-b015-b5b17d8d3cb2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:06.633864 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed407f-9e58-4ef5-b6d1-86cee7709458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:06.634921 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed407f-9e58-4ef5-b6d1-86cee7709458 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:06.635200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed407f-9e58-4ef5-b6d1-86cee7709458 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:06.635520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed407f-9e58-4ef5-b6d1-86cee7709458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:06.636373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed407f-9e58-4ef5-b6d1-86cee7709458 None admin] RBAC: Adding query filter params (group.id=92371f6261d44d70b728753adb15a62f, role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:06.636701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed407f-9e58-4ef5-b6d1-86cee7709458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:06.639203 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed407f-9e58-4ef5-b6d1-86cee7709458 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:06.648817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 212/429] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:59:06 2022] GET /identity/v3/role_assignments?group.id=92371f6261d44d70b728753adb15a62f&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:06.650293 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860715-a5c5-4d12-9d2e-fe37f133b552 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:06.650579 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860715-a5c5-4d12-9d2e-fe37f133b552 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:06.650852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860715-a5c5-4d12-9d2e-fe37f133b552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:06.676479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-db860715-a5c5-4d12-9d2e-fe37f133b552 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:06.678612 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-db860715-a5c5-4d12-9d2e-fe37f133b552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:06.695629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834c1de-ec33-4713-8404-e498c9b8f25b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:06.747830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2e187-61f1-4ddc-9145-827ef74fd140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:06.749394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2e187-61f1-4ddc-9145-827ef74fd140 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:06.749904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2e187-61f1-4ddc-9145-827ef74fd140 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:06.750462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2e187-61f1-4ddc-9145-827ef74fd140 None admin] PATH_INFO: `/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:06.752823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2e187-61f1-4ddc-9145-827ef74fd140 None admin] RBAC: Authorizing `identity:get_project(project_id=2d1b0c2761cb4387b2427fcd3c01356c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:06.755842 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2e187-61f1-4ddc-9145-827ef74fd140 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:06.759670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 218/430] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:06 2022] GET /identity/v3/projects/2d1b0c2761cb4387b2427fcd3c01356c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:06.766622 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2e187-61f1-4ddc-9145-827ef74fd140 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:06.771491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 213/431] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:06.796778 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860715-a5c5-4d12-9d2e-fe37f133b552 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:06.912702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2e187-61f1-4ddc-9145-827ef74fd140 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:06.955867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cc5ce-35e8-4403-8b29-1143ee4f131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:06.957698 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc5ce-35e8-4403-8b29-1143ee4f131f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:06.957976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc5ce-35e8-4403-8b29-1143ee4f131f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:06.958427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc5ce-35e8-4403-8b29-1143ee4f131f None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:06.961400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cc5ce-35e8-4403-8b29-1143ee4f131f None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:06.966831 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cc5ce-35e8-4403-8b29-1143ee4f131f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:06.971791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 219/432] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:06 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:06.984248 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cc5ce-35e8-4403-8b29-1143ee4f131f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:07.008532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860715-a5c5-4d12-9d2e-fe37f133b552 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:07.047582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70907-d974-495c-9fcc-64445564eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:07.048408 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70907-d974-495c-9fcc-64445564eec8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.048700 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70907-d974-495c-9fcc-64445564eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.051390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70907-d974-495c-9fcc-64445564eec8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.069690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c70907-d974-495c-9fcc-64445564eec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-03c70907-d974-495c-9fcc-64445564eec8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:07.086376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:07.087348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:07.088180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:07.090853 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 214/433] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:59:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:07.100729 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70907-d974-495c-9fcc-64445564eec8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:07.121188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cc5ce-35e8-4403-8b29-1143ee4f131f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:07.186800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:07.187425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.187709 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.187984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.194163 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] RBAC: Adding query filter params (group.id=92371f6261d44d70b728753adb15a62f, role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:07.194573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:07.196092 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:07.203438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 220/434] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:59:06 2022] GET /identity/v3/role_assignments?group.id=92371f6261d44d70b728753adb15a62f&scope.project.id=2d1b0c2761cb4387b2427fcd3c01356c&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:07.268161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70907-d974-495c-9fcc-64445564eec8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:07.312402 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e869-000e-42fa-80e8-c1effc6ed775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:07.313530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e869-000e-42fa-80e8-c1effc6ed775 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.314008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e869-000e-42fa-80e8-c1effc6ed775 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.314478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e869-000e-42fa-80e8-c1effc6ed775 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.315460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e869-000e-42fa-80e8-c1effc6ed775 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:07.315980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e869-000e-42fa-80e8-c1effc6ed775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:07.318511 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e869-000e-42fa-80e8-c1effc6ed775 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:07.328647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 215/435] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:07.335618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:07.384784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694906a-0a18-4f82-aba7-701c40a197ce None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.385417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694906a-0a18-4f82-aba7-701c40a197ce None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.385899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694906a-0a18-4f82-aba7-701c40a197ce None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.387874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 216/436] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:59:07.395081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee2b6-57b6-4a69-af3a-4df2527eb713 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.395721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee2b6-57b6-4a69-af3a-4df2527eb713 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.396194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee2b6-57b6-4a69-af3a-4df2527eb713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.416077 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bdcee2b6-57b6-4a69-af3a-4df2527eb713 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:07.417862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bdcee2b6-57b6-4a69-af3a-4df2527eb713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:07.465277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947e3d5-2c55-41b0-a9e7-955898fcf988 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:07.494506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 217/437] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:07.517038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa54adf-916b-41d7-9654-68695e0ee45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:07.518357 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54adf-916b-41d7-9654-68695e0ee45a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.518648 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54adf-916b-41d7-9654-68695e0ee45a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.519133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54adf-916b-41d7-9654-68695e0ee45a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.520548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcee2b6-57b6-4a69-af3a-4df2527eb713 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:07.614709 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa54adf-916b-41d7-9654-68695e0ee45a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:07.616658 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa54adf-916b-41d7-9654-68695e0ee45a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:07.653565 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcee2b6-57b6-4a69-af3a-4df2527eb713 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:07.713115 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73a4d5-c85e-4e49-90ce-ae6673c54337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:07.713923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a4d5-c85e-4e49-90ce-ae6673c54337 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.714200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a4d5-c85e-4e49-90ce-ae6673c54337 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.714473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a4d5-c85e-4e49-90ce-ae6673c54337 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.728992 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73a4d5-c85e-4e49-90ce-ae6673c54337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5e73a4d5-c85e-4e49-90ce-ae6673c54337 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:07.736730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:07.737676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 13:59:07.738642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:07.743502 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 218/438] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:07.744619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73a4d5-c85e-4e49-90ce-ae6673c54337 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:07.752897 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 221/439] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:07.758802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa54adf-916b-41d7-9654-68695e0ee45a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:07.907161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73a4d5-c85e-4e49-90ce-ae6673c54337 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:07.916962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa54adf-916b-41d7-9654-68695e0ee45a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:07.964095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177408a-983e-45ac-80ff-d8912aa6835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:07.965057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177408a-983e-45ac-80ff-d8912aa6835b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.965333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177408a-983e-45ac-80ff-d8912aa6835b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.965453 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:07.965642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177408a-983e-45ac-80ff-d8912aa6835b None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.966156 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:07.966486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:07.966794 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:07.967037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177408a-983e-45ac-80ff-d8912aa6835b None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:07.967725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:07.968235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:07.968475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177408a-983e-45ac-80ff-d8912aa6835b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:07.970109 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:07.978165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 222/440] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:07 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:07.980454 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177408a-983e-45ac-80ff-d8912aa6835b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:07.982109 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 219/441] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 13:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:07.987657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:08.120355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ee7d-9c33-4a6e-aa25-b5f5f75d77e4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:08.124372 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177408a-983e-45ac-80ff-d8912aa6835b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:08.162963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f7a6-e61e-4db7-8cea-3d30a51ee57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:08.163617 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f7a6-e61e-4db7-8cea-3d30a51ee57b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:08.163900 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f7a6-e61e-4db7-8cea-3d30a51ee57b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:08.164169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f7a6-e61e-4db7-8cea-3d30a51ee57b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:08.167068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c348-8def-434a-b68e-4c9ebc45c345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:08.168587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c348-8def-434a-b68e-4c9ebc45c345 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:08.169094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c348-8def-434a-b68e-4c9ebc45c345 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:08.169374 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c348-8def-434a-b68e-4c9ebc45c345 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:08.171450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971c348-8def-434a-b68e-4c9ebc45c345 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:08.174317 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971c348-8def-434a-b68e-4c9ebc45c345 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:08.184059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 223/442] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:07 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:08.184059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c962b2-90ad-4582-8a37-f9e076f49e22 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:08.184059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c962b2-90ad-4582-8a37-f9e076f49e22 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:08.184059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c962b2-90ad-4582-8a37-f9e076f49e22 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:08.184769 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 224/443] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:08.186119 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c962b2-90ad-4582-8a37-f9e076f49e22 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:08.265337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f7a6-e61e-4db7-8cea-3d30a51ee57b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:08.267801 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f7a6-e61e-4db7-8cea-3d30a51ee57b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:08.342641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c962b2-90ad-4582-8a37-f9e076f49e22 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:08.400136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5606a3-a3a3-4160-a223-3cd60bef280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:08.400979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5606a3-a3a3-4160-a223-3cd60bef280f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:08.401311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5606a3-a3a3-4160-a223-3cd60bef280f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:08.401656 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5606a3-a3a3-4160-a223-3cd60bef280f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:08.402592 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5606a3-a3a3-4160-a223-3cd60bef280f None admin] RBAC: Adding query filter params (group.id=92371f6261d44d70b728753adb15a62f, role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=e009c372f03c453eb347cdb038de6fab) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:08.403019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5606a3-a3a3-4160-a223-3cd60bef280f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:08.404630 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5606a3-a3a3-4160-a223-3cd60bef280f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:08.411845 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 225/444] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:59:08 2022] GET /identity/v3/role_assignments?group.id=92371f6261d44d70b728753adb15a62f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:08.414218 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0664caf-faaf-41cd-8236-4d3199a5ca2a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:08.414705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0664caf-faaf-41cd-8236-4d3199a5ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:08.415176 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0664caf-faaf-41cd-8236-4d3199a5ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:08.417076 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 220/445] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 13:59:08.423539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f7a6-e61e-4db7-8cea-3d30a51ee57b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:08.443015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f0664caf-faaf-41cd-8236-4d3199a5ca2a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:08.445048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f0664caf-faaf-41cd-8236-4d3199a5ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:08.559813 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 226/446] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:08.571607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f7a6-e61e-4db7-8cea-3d30a51ee57b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:08.598911 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0664caf-faaf-41cd-8236-4d3199a5ca2a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:08.638380 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c466b1-89f9-4b60-8e4c-d55398658195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:08.640024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c466b1-89f9-4b60-8e4c-d55398658195 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:08.640512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c466b1-89f9-4b60-8e4c-d55398658195 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:08.641047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c466b1-89f9-4b60-8e4c-d55398658195 None admin] PATH_INFO: `/v3/projects/e009c372f03c453eb347cdb038de6fab` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:08.643426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c466b1-89f9-4b60-8e4c-d55398658195 None admin] RBAC: Authorizing `identity:get_project(project_id=e009c372f03c453eb347cdb038de6fab)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:08.646403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c466b1-89f9-4b60-8e4c-d55398658195 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:08.654762 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 221/447] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:08 2022] GET /identity/v3/projects/e009c372f03c453eb347cdb038de6fab => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:08.656386 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c466b1-89f9-4b60-8e4c-d55398658195 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:08.763909 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0664caf-faaf-41cd-8236-4d3199a5ca2a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:08.790862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c466b1-89f9-4b60-8e4c-d55398658195 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:08.812397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c84382-7d51-4b71-867e-d8d581d0298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:08.813131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c84382-7d51-4b71-867e-d8d581d0298b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:08.813413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c84382-7d51-4b71-867e-d8d581d0298b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:08.813687 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c84382-7d51-4b71-867e-d8d581d0298b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:08.826873 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c84382-7d51-4b71-867e-d8d581d0298b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:08.833515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d0c3-8615-42db-bb56-06a834b83517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:08.834466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d0c3-8615-42db-bb56-06a834b83517 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:08.834824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d0c3-8615-42db-bb56-06a834b83517 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:08.835154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d0c3-8615-42db-bb56-06a834b83517 None admin] PATH_INFO: `/v3/groups/92371f6261d44d70b728753adb15a62f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:08.836539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d0c3-8615-42db-bb56-06a834b83517 None admin] RBAC: Authorizing `identity:get_group(group_id=92371f6261d44d70b728753adb15a62f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e2c84382-7d51-4b71-867e-d8d581d0298b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:08.836785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:08.838750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:08.839923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:08.840531 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d0c3-8615-42db-bb56-06a834b83517 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:08.840627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 227/448] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:08.850058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 222/449] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:08 2022] GET /identity/v3/groups/92371f6261d44d70b728753adb15a62f => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:08.850315 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c84382-7d51-4b71-867e-d8d581d0298b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:08.851244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d0c3-8615-42db-bb56-06a834b83517 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:08.987278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c84382-7d51-4b71-867e-d8d581d0298b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:08.992002 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d0c3-8615-42db-bb56-06a834b83517 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:09.022771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:09.023446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:09.023722 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:09.023989 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:09.024791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:09.025093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:09.026486 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:09.044439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 228/450] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:09.045986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:09.046666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:09.047730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:09.048192 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:09.048652 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:09.050189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] RBAC: Adding query filter params (group.id=92371f6261d44d70b728753adb15a62f, role.id=8e27b8e86fc845e9b8569e559e21603f, scope.project.id=e009c372f03c453eb347cdb038de6fab) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:09.051202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:09.053992 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:09.065257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 223/451] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:59:08 2022] GET /identity/v3/role_assignments?group.id=92371f6261d44d70b728753adb15a62f&scope.project.id=e009c372f03c453eb347cdb038de6fab&role.id=8e27b8e86fc845e9b8569e559e21603f => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:09.195307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27b28e-45b1-487a-9e34-a53f77f938a7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:09.237369 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd6be1-0e37-4864-903a-372b95a30d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:09.238720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6be1-0e37-4864-903a-372b95a30d49 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:09.239114 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6be1-0e37-4864-903a-372b95a30d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:09.239480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6be1-0e37-4864-903a-372b95a30d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:09.330842 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd6be1-0e37-4864-903a-372b95a30d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:09.333641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd6be1-0e37-4864-903a-372b95a30d49 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:09.462388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 229/452] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 13:59:09.468441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:09.602488 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0cb1-b699-4df3-8b97-5abdfa89414d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:09.649775 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d882df-d6fd-4f7b-8c22-5835638d3ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:09.651313 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d882df-d6fd-4f7b-8c22-5835638d3ebf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:09.651785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d882df-d6fd-4f7b-8c22-5835638d3ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:09.652252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d882df-d6fd-4f7b-8c22-5835638d3ebf None admin] PATH_INFO: `/v3/projects/4548a84ff35448d493ae9458aa7d0261` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:09.654090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d882df-d6fd-4f7b-8c22-5835638d3ebf None admin] RBAC: Authorizing `identity:get_project(project_id=4548a84ff35448d493ae9458aa7d0261)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:09.656185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d882df-d6fd-4f7b-8c22-5835638d3ebf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:09.658160 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 224/453] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 13:59:09 2022] GET /identity/v3/projects/4548a84ff35448d493ae9458aa7d0261 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:09.665282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd6be1-0e37-4864-903a-372b95a30d49 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:09.777210 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd6be1-0e37-4864-903a-372b95a30d49 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:09.810777 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cec8cf-278d-48e4-8f14-d909b0dbeb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:09.811634 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec8cf-278d-48e4-8f14-d909b0dbeb73 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:09.811913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec8cf-278d-48e4-8f14-d909b0dbeb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:09.812185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec8cf-278d-48e4-8f14-d909b0dbeb73 None admin] PATH_INFO: `/v3/groups/7856461cead549ee94422357f1f647de` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:09.813349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cec8cf-278d-48e4-8f14-d909b0dbeb73 None admin] RBAC: Authorizing `identity:get_group(group_id=7856461cead549ee94422357f1f647de)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:09.814799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cec8cf-278d-48e4-8f14-d909b0dbeb73 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:09.816411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 230/454] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 13:59:09 2022] GET /identity/v3/groups/7856461cead549ee94422357f1f647de => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:09.822465 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d882df-d6fd-4f7b-8c22-5835638d3ebf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:09.927936 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d882df-d6fd-4f7b-8c22-5835638d3ebf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:09.963618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6fc2-1ffe-4a64-8231-392dd2ceceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:09.964279 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6fc2-1ffe-4a64-8231-392dd2ceceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:09.964563 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6fc2-1ffe-4a64-8231-392dd2ceceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:09.964870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6fc2-1ffe-4a64-8231-392dd2ceceb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:09.965715 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6fc2-1ffe-4a64-8231-392dd2ceceb1 None admin] RBAC: Adding query filter params (group.id=7856461cead549ee94422357f1f647de, role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=4548a84ff35448d493ae9458aa7d0261) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:09.966025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6fc2-1ffe-4a64-8231-392dd2ceceb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:09.967466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6fc2-1ffe-4a64-8231-392dd2ceceb1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:09.974528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 225/455] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 13:59:09 2022] GET /identity/v3/role_assignments?group.id=7856461cead549ee94422357f1f647de&scope.project.id=4548a84ff35448d493ae9458aa7d0261&role.id=52bf3a299728408b8384e30e08547fd8 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:12.864663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0178d-59a6-44d5-8138-0a4d0cd0500a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:12.865606 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0178d-59a6-44d5-8138-0a4d0cd0500a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:12.866051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0178d-59a6-44d5-8138-0a4d0cd0500a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:12.867652 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 231/456] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:12.874750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40401453-7f9e-4c8b-8e07-17dc32d1e5af None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:12.875274 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40401453-7f9e-4c8b-8e07-17dc32d1e5af None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:12.875363 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40401453-7f9e-4c8b-8e07-17dc32d1e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:12.911162 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-40401453-7f9e-4c8b-8e07-17dc32d1e5af None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:12.912407 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-40401453-7f9e-4c8b-8e07-17dc32d1e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:13.061650 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 226/457] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:13.098613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0178d-59a6-44d5-8138-0a4d0cd0500a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:13.290715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0178d-59a6-44d5-8138-0a4d0cd0500a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:13.364755 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c93778-b0fd-4cf8-82c7-74b7b517fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:13.365714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93778-b0fd-4cf8-82c7-74b7b517fcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:13.365990 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93778-b0fd-4cf8-82c7-74b7b517fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:13.366272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93778-b0fd-4cf8-82c7-74b7b517fcd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:13.382666 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c93778-b0fd-4cf8-82c7-74b7b517fcd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:13.385229 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c93778-b0fd-4cf8-82c7-74b7b517fcd1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-96c93778-b0fd-4cf8-82c7-74b7b517fcd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:13.419975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:13.421661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:13.424815 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:13.424815 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:13.424815 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:13.424815 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:13.424815 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 232/458] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:13.435002 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40401453-7f9e-4c8b-8e07-17dc32d1e5af None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:13.517932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4dd3-9d28-4871-927e-c11ba7025c99 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:13.518497 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4dd3-9d28-4871-927e-c11ba7025c99 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:13.518629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4dd3-9d28-4871-927e-c11ba7025c99 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:13.520781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 233/459] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:59:13.526766 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7611-54b1-4c6c-992a-edfb58348184 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:13.527095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7611-54b1-4c6c-992a-edfb58348184 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:13.527322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7611-54b1-4c6c-992a-edfb58348184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:13.558555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0cbc7611-54b1-4c6c-992a-edfb58348184 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:13.558555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0cbc7611-54b1-4c6c-992a-edfb58348184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:13.639808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40401453-7f9e-4c8b-8e07-17dc32d1e5af None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:13.706699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:13.708005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:13.708283 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:13.708589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:13.709359 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:13.709905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:13.711092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:13.713100 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 234/460] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:13.733366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7611-54b1-4c6c-992a-edfb58348184 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:13.734964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 227/461] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:13.741415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:13.927024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044edff6-f3b2-4a0a-af8c-444e563cf553 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:13.935043 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7611-54b1-4c6c-992a-edfb58348184 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:13.985779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e6fa-6b02-4d99-9683-4401b6a4d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:13.986888 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e6fa-6b02-4d99-9683-4401b6a4d53d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:13.987331 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e6fa-6b02-4d99-9683-4401b6a4d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:13.987763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e6fa-6b02-4d99-9683-4401b6a4d53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.005830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34923cf-4471-47ae-b9f5-d81452ae64a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:14.006818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34923cf-4471-47ae-b9f5-d81452ae64a0 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.007249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34923cf-4471-47ae-b9f5-d81452ae64a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.007669 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34923cf-4471-47ae-b9f5-d81452ae64a0 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.008548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34923cf-4471-47ae-b9f5-d81452ae64a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:14.010194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34923cf-4471-47ae-b9f5-d81452ae64a0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:14.023175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e6fa-6b02-4d99-9683-4401b6a4d53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:14.026056 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e6fa-6b02-4d99-9683-4401b6a4d53d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:14.049405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 228/462] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:59:13 2022] POST /identity/v3/users => generated 246 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-08f7e6fa-6b02-4d99-9683-4401b6a4d53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:14.068215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:14.073175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:14.074212 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:14.074212 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:14.074212 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:14.074212 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:14.076356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 235/463] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:14.083786 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34923cf-4471-47ae-b9f5-d81452ae64a0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:14.131599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693431-e574-47a6-b4b4-6c8e6b78ae24 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.132192 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693431-e574-47a6-b4b4-6c8e6b78ae24 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.132625 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693431-e574-47a6-b4b4-6c8e6b78ae24 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.134384 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 236/464] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:14.142451 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537d04-d180-421b-816f-f3a8a2c2984f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.142980 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537d04-d180-421b-816f-f3a8a2c2984f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.143414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537d04-d180-421b-816f-f3a8a2c2984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.164694 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-43537d04-d180-421b-816f-f3a8a2c2984f None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:14.166208 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-43537d04-d180-421b-816f-f3a8a2c2984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:14.251931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 237/465] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:14.278063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34923cf-4471-47ae-b9f5-d81452ae64a0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:14.280543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537d04-d180-421b-816f-f3a8a2c2984f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:14.352263 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:14.352981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.353265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.353545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.354297 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:14.354616 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:14.356028 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:14.376907 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 229/466] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:14.387442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:14.470898 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537d04-d180-421b-816f-f3a8a2c2984f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:14.502892 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cc578-a515-433c-b8dc-c13aa6ab0ab5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:14.543141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9b06-55a6-4450-83e5-df5763c520b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:14.543857 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9b06-55a6-4450-83e5-df5763c520b4 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.544140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9b06-55a6-4450-83e5-df5763c520b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.544417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9b06-55a6-4450-83e5-df5763c520b4 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.545232 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9b06-55a6-4450-83e5-df5763c520b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:14.546734 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9b06-55a6-4450-83e5-df5763c520b4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:14.546871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5aaa-aa49-4489-b3d8-9b0406984054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:14.548118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5aaa-aa49-4489-b3d8-9b0406984054 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.548576 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5aaa-aa49-4489-b3d8-9b0406984054 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.549074 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5aaa-aa49-4489-b3d8-9b0406984054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.570705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb5aaa-aa49-4489-b3d8-9b0406984054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:14.573689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb5aaa-aa49-4489-b3d8-9b0406984054 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:14.577392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 230/467] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:59:14 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-43fb5aaa-aa49-4489-b3d8-9b0406984054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:14.624002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:14.625084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:14.625913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:14.625913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:14.625913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:14.625913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:14.626919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 238/468] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:14.634417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9b06-55a6-4450-83e5-df5763c520b4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:14.742387 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89e70-40b4-41f2-ab4f-2639b904d276 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.742875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89e70-40b4-41f2-ab4f-2639b904d276 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.743354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89e70-40b4-41f2-ab4f-2639b904d276 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.753596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 239/469] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:14.758975 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9b06-55a6-4450-83e5-df5763c520b4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:14.760057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eb655-9f4b-4249-9ef5-25e70edd12e4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.760556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eb655-9f4b-4249-9ef5-25e70edd12e4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.761077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eb655-9f4b-4249-9ef5-25e70edd12e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.802540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:14.803246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.803594 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.803879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.804924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:14.805234 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:14.806683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:14.819810 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9e8eb655-9f4b-4249-9ef5-25e70edd12e4 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:14.821203 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 231/470] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:14.822092 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9e8eb655-9f4b-4249-9ef5-25e70edd12e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:14.826921 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:14.953854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593617-1954-4407-b00f-1d87d4fa3b75 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:14.955348 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 240/471] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:14.960701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d64b5b-b2da-43d4-93a5-64f7082557f9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.960701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d64b5b-b2da-43d4-93a5-64f7082557f9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.960701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d64b5b-b2da-43d4-93a5-64f7082557f9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.964347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 241/472] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:14.970177 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c267705-ecbb-4fe5-986b-5a16461081fe None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:14.970667 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c267705-ecbb-4fe5-986b-5a16461081fe None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:14.971125 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c267705-ecbb-4fe5-986b-5a16461081fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:14.990956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8c267705-ecbb-4fe5-986b-5a16461081fe None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:14.993318 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8c267705-ecbb-4fe5-986b-5a16461081fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:14.999443 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb604573-8751-461d-87f9-5e3ef4d09b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:15.000142 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604573-8751-461d-87f9-5e3ef4d09b73 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:15.000424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604573-8751-461d-87f9-5e3ef4d09b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:15.001440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604573-8751-461d-87f9-5e3ef4d09b73 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:15.001553 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb604573-8751-461d-87f9-5e3ef4d09b73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:15.005252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb604573-8751-461d-87f9-5e3ef4d09b73 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:15.035183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 232/473] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:59:14 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:59:15.036060 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb604573-8751-461d-87f9-5e3ef4d09b73 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:15.115851 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 242/474] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:15.165210 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c267705-ecbb-4fe5-986b-5a16461081fe None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:15.229143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb604573-8751-461d-87f9-5e3ef4d09b73 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:15.308007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:15.309079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:15.309541 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:15.309989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:15.311374 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:15.314720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:15.327515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.sql.core [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 13:59:15.327515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 13:59:15.327515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [parameters: {'id': '1fd1258b5c1244a294624936be4e5c85', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 13:59:15.327515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80057) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() May 16 13:59:15.367614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return ref.to_dict() May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 13:59:15.368534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application yield resource May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.rollback() May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.force_reraise() May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise self.value May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application session.commit() May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 13:59:15.369451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._prepare_impl() May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.flush() May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._flush(objects) May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application compat.raise_( May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application flush_context.execute() May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rec.execute(self) May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 13:59:15.370298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 13:59:15.371181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 13:59:15.372013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [parameters: {'id': '1fd1258b5c1244a294624936be4e5c85', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:15.372866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 13:59:15.373662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:15.374486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 233/475] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 13:59:15 2022] POST /identity/v3/roles => generated 144 bytes in 335 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:15.379595 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:15.415757 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c267705-ecbb-4fe5-986b-5a16461081fe None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:15.458275 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:15.459507 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:15.459983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:15.460463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:15.471795 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:15.474300 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:15.495170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:15.496079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:15.497488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:15.497488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:15.497488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:15.497488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:15.499633 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 243/476] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:15.505972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:15.581478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5345cd-f3f0-4043-9f0c-96f4ae7c904a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:15.616255 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b20578-2060-48e6-bc66-21244b55fbc6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:15.648156 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd489a-6c11-46cf-bb0d-9797e8db680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:15.649592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd489a-6c11-46cf-bb0d-9797e8db680e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:15.650068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd489a-6c11-46cf-bb0d-9797e8db680e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:15.650548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd489a-6c11-46cf-bb0d-9797e8db680e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:15.656086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:15.657139 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:15.657615 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:15.658100 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:15.659022 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:15.659518 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:15.661734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:15.670846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd489a-6c11-46cf-bb0d-9797e8db680e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:15.675233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 244/477] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:15.681171 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9efd489a-6c11-46cf-bb0d-9797e8db680e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:15.688704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:15.689684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 13:59:15.690522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:15.693792 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 234/478] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 13:59:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:15.702402 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd489a-6c11-46cf-bb0d-9797e8db680e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:15.805050 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67297bbe-3848-4e78-b059-f1ae97e99422 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:15.855806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeda66-6923-41ec-ac44-2998d420a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:15.856822 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeda66-6923-41ec-ac44-2998d420a7b9 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:15.857249 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeda66-6923-41ec-ac44-2998d420a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:15.857688 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeda66-6923-41ec-ac44-2998d420a7b9 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:15.858894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeda66-6923-41ec-ac44-2998d420a7b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:15.861288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeda66-6923-41ec-ac44-2998d420a7b9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:15.912607 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 245/479] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:59:15 2022] POST /identity/v3/users => generated 249 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 13:59:16.010471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd489a-6c11-46cf-bb0d-9797e8db680e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:16.115043 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881cacb-e18d-4676-a921-4f3f9aac36c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:16.116031 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881cacb-e18d-4676-a921-4f3f9aac36c9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:16.120708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881cacb-e18d-4676-a921-4f3f9aac36c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:16.120708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881cacb-e18d-4676-a921-4f3f9aac36c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:16.120708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881cacb-e18d-4676-a921-4f3f9aac36c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:16.120708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881cacb-e18d-4676-a921-4f3f9aac36c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:16.121562 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881cacb-e18d-4676-a921-4f3f9aac36c9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:16.147624 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 235/480] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:18.574195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec132a6-cb12-4014-99d0-ebb9f5e6aa10 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:18.575122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec132a6-cb12-4014-99d0-ebb9f5e6aa10 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:18.575546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec132a6-cb12-4014-99d0-ebb9f5e6aa10 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:18.577453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 246/481] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:18.583758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e32a6-c455-4c66-bf21-65e43c1c0d23 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:18.584702 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e32a6-c455-4c66-bf21-65e43c1c0d23 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:18.585143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e32a6-c455-4c66-bf21-65e43c1c0d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:18.622067 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5d5e32a6-c455-4c66-bf21-65e43c1c0d23 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:18.623558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5d5e32a6-c455-4c66-bf21-65e43c1c0d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:18.715286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 236/482] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:18.746350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec132a6-cb12-4014-99d0-ebb9f5e6aa10 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:18.781750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0774e-c47f-4aa0-a782-8b2684e6a8ef None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:18.782282 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0774e-c47f-4aa0-a782-8b2684e6a8ef None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:18.782704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0774e-c47f-4aa0-a782-8b2684e6a8ef None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:18.784447 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 237/483] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:18.790440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd366ae-5736-4e4f-85ca-32f62061dcd3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:18.790922 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd366ae-5736-4e4f-85ca-32f62061dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:18.791351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd366ae-5736-4e4f-85ca-32f62061dcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:18.838134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5fd366ae-5736-4e4f-85ca-32f62061dcd3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:18.839535 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5fd366ae-5736-4e4f-85ca-32f62061dcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:18.970967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec132a6-cb12-4014-99d0-ebb9f5e6aa10 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:18.984552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 238/484] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:19.027388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688bed-1310-4b46-b0a2-36593be62c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:19.028458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688bed-1310-4b46-b0a2-36593be62c4b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.028931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688bed-1310-4b46-b0a2-36593be62c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.029355 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688bed-1310-4b46-b0a2-36593be62c4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.042165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e688bed-1310-4b46-b0a2-36593be62c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0e688bed-1310-4b46-b0a2-36593be62c4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:19.050330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:19.052295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:19.053273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:19.053906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd366ae-5736-4e4f-85ca-32f62061dcd3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:19.055847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 247/485] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:19.061858 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688bed-1310-4b46-b0a2-36593be62c4b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:19.218380 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd366ae-5736-4e4f-85ca-32f62061dcd3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:19.267624 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392a0a9-c5f9-42e8-82b5-dadf0f5b8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:19.269098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392a0a9-c5f9-42e8-82b5-dadf0f5b8210 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.269680 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392a0a9-c5f9-42e8-82b5-dadf0f5b8210 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.270665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392a0a9-c5f9-42e8-82b5-dadf0f5b8210 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.312978 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392a0a9-c5f9-42e8-82b5-dadf0f5b8210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9392a0a9-c5f9-42e8-82b5-dadf0f5b8210 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:19.325018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:19.325973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:19.326758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 239/486] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:19.327904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3ffbb-14e3-4b7d-b562-b932da5521cd None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.330950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3ffbb-14e3-4b7d-b562-b932da5521cd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.330950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3ffbb-14e3-4b7d-b562-b932da5521cd None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.334451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 240/487] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:19.336025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf213-4341-4727-b71b-33d79c42987e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.336310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf213-4341-4727-b71b-33d79c42987e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.336583 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf213-4341-4727-b71b-33d79c42987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.355143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-21faf213-4341-4727-b71b-33d79c42987e None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:19.356797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-21faf213-4341-4727-b71b-33d79c42987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:19.370313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688bed-1310-4b46-b0a2-36593be62c4b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:19.429561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 241/488] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:19.430758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faf213-4341-4727-b71b-33d79c42987e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:19.448538 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:19.449805 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.450311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.450902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.453014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:19.453353 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:19.454765 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:19.469700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 248/489] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:19.475083 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:19.551795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faf213-4341-4727-b71b-33d79c42987e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:19.594234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606b95d-0e5e-4f92-b8e0-08400071fac5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:19.611148 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:19.612277 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.612807 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.613273 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.615214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:19.615731 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:19.618220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:19.631423 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104997aa-a2bb-4611-82e7-8df43ca0a7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:19.632237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104997aa-a2bb-4611-82e7-8df43ca0a7dd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.632515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104997aa-a2bb-4611-82e7-8df43ca0a7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.632813 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104997aa-a2bb-4611-82e7-8df43ca0a7dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.636719 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 242/490] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:19.637901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:19.644549 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104997aa-a2bb-4611-82e7-8df43ca0a7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-104997aa-a2bb-4611-82e7-8df43ca0a7dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:19.652386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:19.654450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 249/491] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:19.656312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf706-4d36-4d9a-81ee-420d9b00b168 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.659602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf706-4d36-4d9a-81ee-420d9b00b168 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.659602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf706-4d36-4d9a-81ee-420d9b00b168 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.659602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 250/492] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:19.659602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcf706-4d36-4d9a-81ee-420d9b00b168 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:19.766986 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff4c1-0d33-4bce-941b-120d8c5affd2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:19.793580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcf706-4d36-4d9a-81ee-420d9b00b168 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:19.802631 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:19.803429 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.803705 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.803974 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.815306 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:19.816904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:19.836055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:19.837061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:19.837911 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:19.837911 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:19.837911 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:19.837911 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:19.837911 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 243/493] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:19.838177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:19.854693 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7e791-e44c-4739-b63a-978239e443f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:19.855502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7e791-e44c-4739-b63a-978239e443f5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.855794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7e791-e44c-4739-b63a-978239e443f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.856045 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7e791-e44c-4739-b63a-978239e443f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.868590 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7e791-e44c-4739-b63a-978239e443f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:19.871402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7e791-e44c-4739-b63a-978239e443f5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-66b7e791-e44c-4739-b63a-978239e443f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:19.904724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:19.905623 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:19.906466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:19.906466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:19.906466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:19.906466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:19.906466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 251/494] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:19.908474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385e6da-6e2d-4089-a115-a4b8c3bda6c8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:19.908850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385e6da-6e2d-4089-a115-a4b8c3bda6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:19.909194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385e6da-6e2d-4089-a115-a4b8c3bda6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:19.929893 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f385e6da-6e2d-4089-a115-a4b8c3bda6c8 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:19.931103 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f385e6da-6e2d-4089-a115-a4b8c3bda6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:19.976383 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf7c48-a783-4ebe-9d2e-62853b7a2ae2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.005332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 252/495] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:20.006771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385e6da-6e2d-4089-a115-a4b8c3bda6c8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.019532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.020645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.020645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.021089 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.021943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:20.022643 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.023944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:20.034700 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 244/496] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:20.036121 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.131990 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385e6da-6e2d-4089-a115-a4b8c3bda6c8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.167990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e178-cf40-4288-bc0b-4f9432880a85 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.173426 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.174385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.174825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.175855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.176950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:20.177426 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.179851 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:20.209777 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.209777 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.209777 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.209777 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.210218 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:20.210218 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.210353 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 253/497] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:20.210424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:20.211238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.228448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 245/498] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:20.228448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.337683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec526b79-76e6-4c24-aa4c-4844cd8cbcc3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.359417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61694f-5d47-4c19-9771-843465aad57d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.381266 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.382517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.382953 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.383394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.400571 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.403118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:20.409966 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc33177-6068-45d3-9d14-efb396a9fdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.411398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33177-6068-45d3-9d14-efb396a9fdcb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.411747 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33177-6068-45d3-9d14-efb396a9fdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.412143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33177-6068-45d3-9d14-efb396a9fdcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:20.422771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:20.424237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:20.425784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:20.425784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:20.425784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:20.425784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:20.427270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc33177-6068-45d3-9d14-efb396a9fdcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:20.427413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 254/499] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:20.427413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2fc33177-6068-45d3-9d14-efb396a9fdcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:20.431733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:20.432708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:20.433528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 246/500] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:20.434185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc33177-6068-45d3-9d14-efb396a9fdcb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.537530 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23b47-9ca6-46d3-9474-f051b4ced013 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.545727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc33177-6068-45d3-9d14-efb396a9fdcb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.572135 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c5f9f-8cf0-4622-ab50-9d20f90cce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.572968 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5f9f-8cf0-4622-ab50-9d20f90cce58 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.573238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5f9f-8cf0-4622-ab50-9d20f90cce58 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.573506 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5f9f-8cf0-4622-ab50-9d20f90cce58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.580407 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.581247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.581529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.581675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c5f9f-8cf0-4622-ab50-9d20f90cce58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.581817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.583659 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c5f9f-8cf0-4622-ab50-9d20f90cce58 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:20.590852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.592243 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-dc6c5f9f-8cf0-4622-ab50-9d20f90cce58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:20.600067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:20.607756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 255/501] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ca616-182d-4ed3-a826-ce3db3be17d3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.612154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ca616-182d-4ed3-a826-ce3db3be17d3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.613531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ca616-182d-4ed3-a826-ce3db3be17d3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.613531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 256/502] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:20.613531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ca616-182d-4ed3-a826-ce3db3be17d3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:20.613858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:20.615901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 247/503] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:20.617591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.734618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de551fe-45bf-4e98-b461-a6b449d4fbb6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.734949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ca616-182d-4ed3-a826-ce3db3be17d3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.770185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.770666 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed4e6d-9858-4c17-a2d4-6038d0c53a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.770875 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.771228 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.771501 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.771684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4e6d-9858-4c17-a2d4-6038d0c53a56 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.772061 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4e6d-9858-4c17-a2d4-6038d0c53a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.772323 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:20.772561 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4e6d-9858-4c17-a2d4-6038d0c53a56 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.772762 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.773499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed4e6d-9858-4c17-a2d4-6038d0c53a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:20.773938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed4e6d-9858-4c17-a2d4-6038d0c53a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.774091 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:20.775635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed4e6d-9858-4c17-a2d4-6038d0c53a56 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:20.783045 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 248/504] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:20.783895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.791997 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 257/505] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:20.793414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef68e-5687-4dec-89dc-061556718a7d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.793701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef68e-5687-4dec-89dc-061556718a7d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.793959 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef68e-5687-4dec-89dc-061556718a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.811665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4f7ef68e-5687-4dec-89dc-061556718a7d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:20.812917 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4f7ef68e-5687-4dec-89dc-061556718a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:20.910197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 258/506] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:20.912493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef68e-5687-4dec-89dc-061556718a7d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:20.920895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5975c-36bc-41aa-b437-a11f09c8528c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:20.961440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:20.962196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:20.962626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:20.963020 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:20.964020 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:20.964444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:20.966049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:21.010518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 249/507] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:21.011857 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:21.043066 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef68e-5687-4dec-89dc-061556718a7d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:21.086599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:21.087382 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:21.087732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:21.088116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:21.089319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:21.089791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:21.091344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:21.133497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc338706-b7a7-47a0-a080-bd10e27a4225 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:21.138252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 259/508] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 13:59:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:21.139683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:21.188619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:21.189361 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:21.189641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:21.189923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:21.201899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:21.203404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:21.226614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:21.228345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:21.229980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:21.229980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:21.229980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:21.229980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:21.229980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 250/509] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:21.229980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:21.300367 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61130-2bfb-477a-a4c1-6aa78e5c8309 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:21.346295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:21.347192 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:21.347536 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:21.349392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:21.357801 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:21.359444 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:21.362917 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf08a-1d6c-42be-9733-899dec97149b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:21.376534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:21.378332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:21.380589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 260/510] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:21.381735 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:21.406134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:21.407151 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:21.407515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:21.407856 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:21.421350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:21.423159 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:21.442589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:21.444827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:21.446830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:21.446830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:21.446830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:21.446830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:21.446830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 251/511] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:21.446830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:21.546158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffc7b4-652a-4d32-816f-0116acb25d1d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:21.574221 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a225130-6a42-4a44-9b4c-a19334f3c9d9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:21.610494 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5adcbe-dbbf-4317-8178-81977d23bc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:21.611596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adcbe-dbbf-4317-8178-81977d23bc2b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:21.612088 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adcbe-dbbf-4317-8178-81977d23bc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:21.612583 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adcbe-dbbf-4317-8178-81977d23bc2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:21.614729 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28bc2-69c8-4e47-8803-79941675c126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:21.615396 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28bc2-69c8-4e47-8803-79941675c126 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:21.615681 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28bc2-69c8-4e47-8803-79941675c126 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:21.615959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28bc2-69c8-4e47-8803-79941675c126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:21.689345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5adcbe-dbbf-4317-8178-81977d23bc2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:21.690846 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5adcbe-dbbf-4317-8178-81977d23bc2b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:21.723581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b28bc2-69c8-4e47-8803-79941675c126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:21.726293 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b28bc2-69c8-4e47-8803-79941675c126 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:21.804058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 261/512] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:21.805329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5adcbe-dbbf-4317-8178-81977d23bc2b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:21.868634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 252/513] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:21.869720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28bc2-69c8-4e47-8803-79941675c126 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:21.944451 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5adcbe-dbbf-4317-8178-81977d23bc2b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:21.983732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:21.984307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:21.984577 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:21.984883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:21.985620 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:21.985924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:21.987317 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.000781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 262/514] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:22.001714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:22.010707 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28bc2-69c8-4e47-8803-79941675c126 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.066150 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:22.068146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:22.068609 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:22.069105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:22.070483 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:22.071004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:22.073542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.110144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 253/515] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 13:59:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:22.110144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:22.155405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c6764-0e25-4d3c-9900-6cfe47275668 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.190397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:22.191075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:22.191358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:22.192395 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:22.193421 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:22.193743 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:22.195155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.210191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 263/516] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:22.211051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:22.271888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bc77f-4ee3-4101-bd6f-43176cb2a93b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.311197 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:22.311997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:22.312281 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:22.312555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:22.324531 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:22.324816 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8d3b7-712a-4037-8030-8fad17f71c88 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.326072 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:22.347055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:22.349288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:22.351720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:22.351720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:22.351720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:22.351720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:22.351720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 254/517] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:22.351720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:22.370064 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:22.371304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:22.371661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:22.371979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:22.384576 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:22.386138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:22.405392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:22.407194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:22.409280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:22.409280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:22.409280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:22.409280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:22.409280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 264/518] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:22.409280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:22.481080 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a3f85-bf95-4b62-b825-710ed30d3240 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.527577 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:22.528421 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:22.528815 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:22.529171 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:22.539711 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:22.541789 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.547418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7dbc-8543-4910-a793-6662c6875c76 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:22.560634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:22.562486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:22.564036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 255/519] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:22.564870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:22.599710 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ec1db-c303-49a4-818f-2341d72cef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:22.600510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec1db-c303-49a4-818f-2341d72cef7d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:22.600917 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec1db-c303-49a4-818f-2341d72cef7d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:22.601279 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec1db-c303-49a4-818f-2341d72cef7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:22.688034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ec1db-c303-49a4-818f-2341d72cef7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:22.690142 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ec1db-c303-49a4-818f-2341d72cef7d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.695104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee18b0-4440-46a1-9dce-335fb7b0d496 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.734481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff79bf-8071-4e21-9b2d-5be3fd2ecdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:22.735320 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff79bf-8071-4e21-9b2d-5be3fd2ecdcf None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:22.735731 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff79bf-8071-4e21-9b2d-5be3fd2ecdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:22.736122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff79bf-8071-4e21-9b2d-5be3fd2ecdcf None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:22.737012 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff79bf-8071-4e21-9b2d-5be3fd2ecdcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:22.739247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff79bf-8071-4e21-9b2d-5be3fd2ecdcf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.763172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 256/520] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:59:22 2022] POST /identity/v3/users => generated 247 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:59:22.766350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff79bf-8071-4e21-9b2d-5be3fd2ecdcf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:22.822186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 265/521] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:22.823816 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ec1db-c303-49a4-818f-2341d72cef7d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:22.916809 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff79bf-8071-4e21-9b2d-5be3fd2ecdcf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.966085 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:22.966791 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:22.967074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:22.967351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:22.968117 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:22.968426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:22.969902 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:22.986261 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ec1db-c303-49a4-818f-2341d72cef7d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:22.992946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 257/522] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:22.992946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:23.035160 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:23.037123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:23.037418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:23.037706 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:23.038478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:23.038787 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:23.040257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:23.059192 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 266/523] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:23.059192 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:23.135618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935523d-a043-4fd3-b02b-123aff468898 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:23.182676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:23.183767 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:23.184213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:23.184639 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:23.185882 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:23.186317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:23.188345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:23.198526 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04034fd8-7730-4f3c-a4ad-acad65843fc7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:23.213519 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 258/524] 10.222.0.13 () {56 vars in 1139 bytes} [Mon May 16 13:59:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:23.214577 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:23.255901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:23.257047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:23.257505 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:23.258344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:23.275580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:23.278179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:23.307950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:23.308941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:23.309788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:23.309788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:23.309788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:23.309788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:23.314450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 267/525] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:23.314450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:23.377327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d963-622a-4b30-9bd1-8d0d66d55034 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:23.427828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:23.428666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:23.429056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:23.429398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:23.438140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:23.439953 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:23.456912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b049bea-2052-4e1b-ae41-0887ad698040 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:23.458135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:23.459500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:23.460513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 259/526] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:23.461782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:23.516579 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:23.517905 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:23.518363 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:23.518817 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:23.531375 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:23.534009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:23.561194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:23.562322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 268/527] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:23.569014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:23.625435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb53028-6747-472e-b993-1797090f7755 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:23.672062 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248e7de-acf0-4409-89a0-745d5a4a08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:23.673019 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e7de-acf0-4409-89a0-745d5a4a08dc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:23.673467 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e7de-acf0-4409-89a0-745d5a4a08dc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:23.673922 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e7de-acf0-4409-89a0-745d5a4a08dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:23.712563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4857da-11a9-483c-8076-02eff0d2151a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:23.760057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:23.761256 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:23.761785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:23.762286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:23.763660 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:23.764209 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:23.766921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:23.781126 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248e7de-acf0-4409-89a0-745d5a4a08dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:23.783039 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248e7de-acf0-4409-89a0-745d5a4a08dc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:23.795732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 269/528] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:23.795732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:23.936326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 260/529] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:23.937791 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248e7de-acf0-4409-89a0-745d5a4a08dc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:23.967650 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27631d-0ea2-4ae9-86f8-b25a7a1a7b28 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.024353 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.025064 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.025349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.025625 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.026726 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:24.026726 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.028181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.053189 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 270/530] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:24.054421 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:24.092298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248e7de-acf0-4409-89a0-745d5a4a08dc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.135079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.135748 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.136102 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.136289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.137141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:24.137446 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.138888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.166873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 261/531] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:24.166873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:24.170538 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda0b2-9e67-439a-acf1-2c83c5081e2e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.211761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.212717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.213367 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.213563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.222101 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.224924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:24.240517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:24.242145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 271/532] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:24.243768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:24.313429 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2e71-ceee-4521-a837-53573648264e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.363708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.364601 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.364960 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.365257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.380417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.382191 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.396154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49f95f-77c1-40cb-9934-03107b623fa2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:24.403094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:24.404133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:24.405010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:24.405010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:24.405010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:24.405010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:24.405226 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 262/533] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:24.410301 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:24.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.442578 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.443084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.443443 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.444302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=c40d0702d56d47b48afc200b4de3027f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:24.444615 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.446103 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.460788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 272/534] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:24 2022] GET /identity/v3/role_assignments?user.id=c40d0702d56d47b48afc200b4de3027f&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:24.460788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:24.525190 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2cbbe-b0d7-4050-95d0-67c2281389b5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.563131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.563813 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.564096 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.564376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.565267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=6c6aec0d7c7d4904a07bb4b812514701) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:24.565579 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.567262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.580724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 263/535] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:24 2022] GET /identity/v3/role_assignments?user.id=6c6aec0d7c7d4904a07bb4b812514701&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:24.580724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:24.619164 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883b1e1-d77a-4a89-a1f0-11cb3f252d9c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.703855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.704547 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.704872 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.705150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.705973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:24.706278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.708577 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.724245 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 273/536] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:24.731868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:24.758517 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26df0-6216-497e-a739-800dbce9e4e8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.796948 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.797547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.797830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.798111 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.798862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:24.799167 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.800580 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.814835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 264/537] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:24.820893 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:24.867100 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9411b-6b2e-4475-bc4a-21f9cfe34bd7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:24.907652 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:24.908330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:24.908612 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:24.908921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:24.909783 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=7821fd86364744bf9d79e03d32b749fe) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:24.910091 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:24.912140 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:24.922961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 274/538] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:24 2022] GET /identity/v3/role_assignments?user.id=7821fd86364744bf9d79e03d32b749fe&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:24.965675 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a094a6-3c25-4ff3-8e6f-cdf3734e5c8e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:25.009642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:25.010850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:25.011348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:25.011829 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:25.021092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:25.023155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:25.040123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:25.041055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:25.041909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:25.041909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:25.041909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:25.041909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:25.041909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:25.041909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:25.041909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:25.041909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:25.044581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 265/539] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:25.056789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:25.219103 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba805d6-bfca-47d4-89e3-31ac9b0548b3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:25.300198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d3e9c-02eb-4d76-ac88-40cb839f056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:25.300904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3e9c-02eb-4d76-ac88-40cb839f056d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:25.301800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3e9c-02eb-4d76-ac88-40cb839f056d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:25.302078 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3e9c-02eb-4d76-ac88-40cb839f056d None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:25.302881 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d3e9c-02eb-4d76-ac88-40cb839f056d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:25.303185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d3e9c-02eb-4d76-ac88-40cb839f056d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:25.304635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d3e9c-02eb-4d76-ac88-40cb839f056d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:25.326460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 275/540] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:25.331989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:25.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e15d7-e875-4e52-890d-b6ddfd0ac772 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:25.517860 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8237d-06ad-4134-b722-d0b913661919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:25.518537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8237d-06ad-4134-b722-d0b913661919 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:25.518830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8237d-06ad-4134-b722-d0b913661919 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:25.519107 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8237d-06ad-4134-b722-d0b913661919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:25.520520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8237d-06ad-4134-b722-d0b913661919 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=4c352582d4014e008ff92350808c84f9) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:25.520857 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8237d-06ad-4134-b722-d0b913661919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:25.522328 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8237d-06ad-4134-b722-d0b913661919 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:25.533551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 266/541] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:25 2022] GET /identity/v3/role_assignments?user.id=4c352582d4014e008ff92350808c84f9&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:25.662854 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd109-e87c-4cd7-8932-cbb9312c7e82 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:25.663180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd109-e87c-4cd7-8932-cbb9312c7e82 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:25.663358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd109-e87c-4cd7-8932-cbb9312c7e82 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:25.665413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 276/542] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:25.671517 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d46e-7897-4f13-ab70-acb4e12e7351 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:25.671830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d46e-7897-4f13-ab70-acb4e12e7351 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:25.672080 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d46e-7897-4f13-ab70-acb4e12e7351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:25.694529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9664d46e-7897-4f13-ab70-acb4e12e7351 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:25.695788 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9664d46e-7897-4f13-ab70-acb4e12e7351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:25.784027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 267/543] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:25.821535 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cd109-e87c-4cd7-8932-cbb9312c7e82 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:25.966663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cd109-e87c-4cd7-8932-cbb9312c7e82 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:26.020409 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e180c0-d53c-4a8c-9383-c6d44ae8c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:26.021463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e180c0-d53c-4a8c-9383-c6d44ae8c9ea None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:26.021746 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e180c0-d53c-4a8c-9383-c6d44ae8c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:26.022017 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e180c0-d53c-4a8c-9383-c6d44ae8c9ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:26.042999 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e180c0-d53c-4a8c-9383-c6d44ae8c9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a7e180c0-d53c-4a8c-9383-c6d44ae8c9ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:26.050927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:26.053683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:26.055653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 277/544] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:26.061843 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664d46e-7897-4f13-ab70-acb4e12e7351 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:26.202814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664d46e-7897-4f13-ab70-acb4e12e7351 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:26.246031 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:26.246750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:26.247048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:26.247319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:26.248194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:26.248505 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:26.250110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:26.261520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 268/545] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:26.266808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e180c0-d53c-4a8c-9383-c6d44ae8c9ea None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:26.398311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e180c0-d53c-4a8c-9383-c6d44ae8c9ea None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:26.437193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:26.438020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:26.438301 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:26.438575 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:26.451818 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:26.453368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:26.472599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:26.475144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:26.477287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:26.477287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:26.477287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:26.477287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:26.477287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 278/546] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:26.480999 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:26.697247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52764a-0abe-4d5c-bf19-f0f24bf6c7fd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:26.740551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:26.741259 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:26.741545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:26.741817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:26.742571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:26.742871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:26.744288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:26.763526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 269/547] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:26.773343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:26.967738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7507f16-d342-4515-8e26-818befdd6aaf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:27.016570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30033ec0-5422-4c35-b6be-b288b88d1913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:27.017438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033ec0-5422-4c35-b6be-b288b88d1913 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:27.017721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033ec0-5422-4c35-b6be-b288b88d1913 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:27.017994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033ec0-5422-4c35-b6be-b288b88d1913 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:27.027717 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30033ec0-5422-4c35-b6be-b288b88d1913 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:27.029284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30033ec0-5422-4c35-b6be-b288b88d1913 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-30033ec0-5422-4c35-b6be-b288b88d1913 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:27.048388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:27.050554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:27.053516 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:27.055438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 279/548] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:27.066493 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:27.304660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ef53-b710-4ed0-929b-e5c55c61ea43 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:27.371325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:27.372452 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:27.372987 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:27.373478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:27.375084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:27.375624 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:27.378315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:27.416791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5423-5179-40e3-ae47-14f38d2ad4c7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:27.416791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5423-5179-40e3-ae47-14f38d2ad4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:27.416791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5423-5179-40e3-ae47-14f38d2ad4c7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:27.416791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 280/549] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:27.418672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 270/550] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 13:59:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:27.424204 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6339-b13a-40b7-beeb-2d020d1d840a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:27.424204 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6339-b13a-40b7-beeb-2d020d1d840a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:27.424204 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6339-b13a-40b7-beeb-2d020d1d840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:27.425958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:27.461591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-91cf6339-b13a-40b7-beeb-2d020d1d840a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:27.463638 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-91cf6339-b13a-40b7-beeb-2d020d1d840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:27.611187 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 281/551] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:27.633846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d09cff-328c-4c89-b943-b5cd2efb6e5b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:27.658635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6339-b13a-40b7-beeb-2d020d1d840a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:27.696153 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be7d58-17bb-4499-a08c-26762b40bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:27.697187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be7d58-17bb-4499-a08c-26762b40bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:27.697706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be7d58-17bb-4499-a08c-26762b40bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:27.698224 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be7d58-17bb-4499-a08c-26762b40bcb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:27.787920 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be7d58-17bb-4499-a08c-26762b40bcb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:27.789817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be7d58-17bb-4499-a08c-26762b40bcb3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:27.790432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6339-b13a-40b7-beeb-2d020d1d840a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:27.826830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dd346-2a11-46ab-80c2-8546e129ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:27.827639 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dd346-2a11-46ab-80c2-8546e129ac79 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:27.827916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dd346-2a11-46ab-80c2-8546e129ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:27.828186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dd346-2a11-46ab-80c2-8546e129ac79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:27.840499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dd346-2a11-46ab-80c2-8546e129ac79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e72dd346-2a11-46ab-80c2-8546e129ac79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:27.849424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:27.850396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:27.851165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:27.855771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 282/552] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:27.857242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405da78-0c14-4fc3-82a2-c4cb8fdd2c97 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:27.857503 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405da78-0c14-4fc3-82a2-c4cb8fdd2c97 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:27.857782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405da78-0c14-4fc3-82a2-c4cb8fdd2c97 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:27.859427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 283/553] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:27.860366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405da78-0c14-4fc3-82a2-c4cb8fdd2c97 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:27.905536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 271/554] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:27.907177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579d13-7f3c-4209-ae93-acb102d660b5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:27.907679 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579d13-7f3c-4209-ae93-acb102d660b5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:27.908189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579d13-7f3c-4209-ae93-acb102d660b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:27.927353 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f1579d13-7f3c-4209-ae93-acb102d660b5 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:27.929002 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f1579d13-7f3c-4209-ae93-acb102d660b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:27.998796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405da78-0c14-4fc3-82a2-c4cb8fdd2c97 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.024812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 272/555] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:28.026101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579d13-7f3c-4209-ae93-acb102d660b5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.035403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.036446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.037069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.037313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.038225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:28.038622 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:28.040156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:28.049337 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 284/556] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:28.059097 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.203575 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8fe45-17bb-42eb-9a27-43d9d46b153b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.221672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579d13-7f3c-4209-ae93-acb102d660b5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.264712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.266068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.266545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.266992 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.267157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.268077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.268384 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.268751 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.279174 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:28.281169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:28.282817 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:28.285040 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:28.302835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:28.303746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:28.304568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:28.304568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:28.304568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:28.304568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:28.306591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:28.307488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:28.308320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:28.308320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:28.308320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:28.308320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:28.309145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 273/557] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:28.310219 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.312801 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 285/558] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:28.315229 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.423721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290086f6-07d8-4e3a-b951-e8525b5b95e7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.439052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2c600-53f8-4b2f-8fb0-9b329961d16b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.457900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.458441 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.458831 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.459110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.459841 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:28.460142 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:28.461566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:28.473815 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831dbe0-65e4-44ed-97b5-c46e38c7097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.474860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 286/559] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:28.475118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dbe0-65e4-44ed-97b5-c46e38c7097a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.475566 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dbe0-65e4-44ed-97b5-c46e38c7097a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.475699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.476196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dbe0-65e4-44ed-97b5-c46e38c7097a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.491151 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831dbe0-65e4-44ed-97b5-c46e38c7097a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d831dbe0-65e4-44ed-97b5-c46e38c7097a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:28.499717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:28.500941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 274/560] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:28.506706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095933-7d82-4d53-b644-12384a4fc4b2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.507409 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095933-7d82-4d53-b644-12384a4fc4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.507409 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095933-7d82-4d53-b644-12384a4fc4b2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.507409 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 275/561] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:28.507409 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67095933-7d82-4d53-b644-12384a4fc4b2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656dbe5-9b8d-42cd-bed3-fd56a12fa1b1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.619447 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67095933-7d82-4d53-b644-12384a4fc4b2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.639485 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.641035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.641808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.642286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.643735 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:28.644528 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:28.647029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:28.653945 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147eaa3-e7c9-4dd1-921c-db8767f1b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.654745 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147eaa3-e7c9-4dd1-921c-db8767f1b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.655023 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147eaa3-e7c9-4dd1-921c-db8767f1b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.655294 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147eaa3-e7c9-4dd1-921c-db8767f1b4c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.664537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 287/562] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:28.665511 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.667456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147eaa3-e7c9-4dd1-921c-db8767f1b4c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:28.669141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147eaa3-e7c9-4dd1-921c-db8767f1b4c2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a147eaa3-e7c9-4dd1-921c-db8767f1b4c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:28.685155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:28.686738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 276/563] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:28.687821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8681-a133-4ff5-bc6d-d0fd3adbe021 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.688465 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8681-a133-4ff5-bc6d-d0fd3adbe021 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.688465 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8681-a133-4ff5-bc6d-d0fd3adbe021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.706124 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-840e8681-a133-4ff5-bc6d-d0fd3adbe021 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:28.707303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-840e8681-a133-4ff5-bc6d-d0fd3adbe021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:28.773050 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d05b76-81b2-457d-a0be-7f0aae232e89 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.784888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 277/564] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:28.784888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e8681-a133-4ff5-bc6d-d0fd3adbe021 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.822771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.823452 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.824246 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.824526 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.825312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:28.825988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:28.827363 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:28.835948 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 288/565] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:28.841174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.883291 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e8681-a133-4ff5-bc6d-d0fd3adbe021 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.925904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.926970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.927413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.927778 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:28.935997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:28.937566 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:28.949789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18aaf3-c9a2-4257-985c-36f98d4d36a0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:28.952546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:28.953564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:28.954428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 278/566] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:28.954899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:28.997851 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:28.998886 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:28.999460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:28.999675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.001169 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:29.001678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.004056 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.027590 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 289/567] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:29.028346 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.078163 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dfa7e-d2c5-4266-874e-3b8b38d70865 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.112661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cd9c5-bb8d-4b60-a586-9c02142f9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.113486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cd9c5-bb8d-4b60-a586-9c02142f9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.114556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cd9c5-bb8d-4b60-a586-9c02142f9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.114835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cd9c5-bb8d-4b60-a586-9c02142f9ff1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.124904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cd9c5-bb8d-4b60-a586-9c02142f9ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:29.128915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7bee-e758-4b7d-9234-b0c938391a11 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-805cd9c5-bb8d-4b60-a586-9c02142f9ff1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:29.133322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:29.135213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 279/568] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:29.137018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c2db-833f-41f4-b2d4-e430335e1284 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.139432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c2db-833f-41f4-b2d4-e430335e1284 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.139432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c2db-833f-41f4-b2d4-e430335e1284 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.139432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 280/569] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:29.139432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022c2db-833f-41f4-b2d4-e430335e1284 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.172843 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.174121 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.174578 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.175042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.191245 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.193713 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:29.222903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:29.226408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:29.228084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:29.228084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:29.228084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:29.228084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:29.228084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 290/570] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:29.228084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.272837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022c2db-833f-41f4-b2d4-e430335e1284 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.310308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.310895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.311168 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.311445 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.312231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:29.312532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.314014 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.326540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 281/571] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:29.327382 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.334594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc006729-5d33-45cd-9a84-91b9c2b2ecf2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.369863 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a9f88-733d-4e2c-86f7-25c2919f1b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.370664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a9f88-733d-4e2c-86f7-25c2919f1b34 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.370945 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a9f88-733d-4e2c-86f7-25c2919f1b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.371246 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a9f88-733d-4e2c-86f7-25c2919f1b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.382680 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a9f88-733d-4e2c-86f7-25c2919f1b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.384620 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a9f88-733d-4e2c-86f7-25c2919f1b34 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a70a9f88-733d-4e2c-86f7-25c2919f1b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:29.411850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:29.413004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:29.418631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:29.418631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:29.418631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:29.418631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:29.418631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 291/572] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:29.418631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2bae9-0b23-4534-b3f7-1c3674b1cd20 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.418631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2bae9-0b23-4534-b3f7-1c3674b1cd20 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.418631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2bae9-0b23-4534-b3f7-1c3674b1cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.439564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9fa2bae9-0b23-4534-b3f7-1c3674b1cd20 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:29.441454 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9fa2bae9-0b23-4534-b3f7-1c3674b1cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:29.441874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e5ef0-6439-4a22-a3ee-91db25b4d4f8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.491960 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.493046 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.493385 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.493702 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.494902 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:29.495455 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.497828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.510915 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 282/573] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:29.512239 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.533335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 292/574] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:29.534181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2bae9-0b23-4534-b3f7-1c3674b1cd20 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.611859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e971ffa-5564-4456-85d8-0634d868319a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.641170 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2bae9-0b23-4534-b3f7-1c3674b1cd20 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.648385 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.649099 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.649382 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.649660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.650417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:29.650748 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.652156 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.665309 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 283/575] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:29.666168 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.683328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.684293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.684780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.685208 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.686644 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=0734d46e1f4c4994a03d56f0591dfded) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:29.687157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.689501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.698649 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 293/576] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/role_assignments?user.id=0734d46e1f4c4994a03d56f0591dfded&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:29.699798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.797349 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40de8c-221a-47fd-8c30-0311822ff589 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.828570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4099-591a-4999-80a2-44072f158710 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:29.835767 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.836453 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.836768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.837023 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.837776 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:29.838078 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.839506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.853716 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 284/577] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:29.854596 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:29.878619 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:29.879948 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:29.880231 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:29.880499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:29.892377 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:29.893896 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:29.918133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:29.919085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:29.925086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:29.925086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:29.925086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:29.925086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:29.925086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 294/578] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:29.925086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.014753 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2795c6-3fcc-4165-901f-b14f221f7192 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.030385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90fbd8-e48e-4746-bb27-791eff7192ba None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.059572 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043e41b-613a-4194-8106-33c8f733368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.061217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043e41b-613a-4194-8106-33c8f733368d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.061677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043e41b-613a-4194-8106-33c8f733368d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.062127 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043e41b-613a-4194-8106-33c8f733368d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.075129 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.076385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.076878 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.077329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.079169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043e41b-613a-4194-8106-33c8f733368d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:30.090425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.092934 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0043e41b-613a-4194-8106-33c8f733368d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:30.093837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:30.094749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:30.095581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:30.096249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 285/579] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:30.097215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043e41b-613a-4194-8106-33c8f733368d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:30.115327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:30.116556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 13:59:30.117718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:30.124264 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 295/580] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:30.124264 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.220725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043e41b-613a-4194-8106-33c8f733368d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.277290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.278708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.279151 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.279542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.282081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b766ad1-18fd-453c-bc5e-6d0ad577cee6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.289486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.291987 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:30.316262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:30.318440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:30.320367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:30.320367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:30.320367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:30.320367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:30.320367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:30.320367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:30.320367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:30.320367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:30.324342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 286/581] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:30.325522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.345638 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.346728 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.347240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.347768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.349914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:30.350487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.352622 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.370461 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 296/582] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:30.371534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.490388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040d45c-7d70-4587-be3a-66288b5c3b4a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.515895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4cd22-f464-4da1-85ed-e49f56aac656 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.529526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.530200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.530479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.530750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.531504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:30.531799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.533272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.548205 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 287/583] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:30.548205 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.561844 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.562636 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.562988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.563352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.564278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:30.564664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.592475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 297/584] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:30.592475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.675625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d53ab-6f92-42d4-8612-11fe03b2e0b4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.700076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd96f7-356b-4476-bc42-da82365a9fd0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.721562 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.722693 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.723927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.724218 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.725504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:30.726058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.728741 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.736438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.737256 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.737528 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.737795 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.749664 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 288/585] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:30.749664 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.751390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.752882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:30.768700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:30.770796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 13:59:30.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:30.775151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 298/586] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:30.776244 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.869647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89644bd4-d21b-41f2-9e0b-c1261884c95d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.891368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699d074-0e7f-41e7-a8a2-9442ccb59dbe None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:30.910613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.912201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.912860 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.913475 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.930480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.932118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:30.932324 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.933020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:30.933226 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:30.933504 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:30.945216 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:30.946849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:30.951724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:30.953431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:30.954498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:30.954498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:30.954498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:30.954498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:30.960890 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 289/587] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:30.960890 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:30.966882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:30.968166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:30.970257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:30.970257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:30.970257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:30.970257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:30.972657 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 299/588] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:30.974525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:31.086820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0debf-8637-476b-b7c7-41be21bdfe44 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:31.088552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deae4f0-0a29-4fa2-ad8f-ac55b6348dc8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:31.124123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa12c5b-59b2-40b8-869d-e10284a05879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:31.125062 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12c5b-59b2-40b8-869d-e10284a05879 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:31.125220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:31.125398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12c5b-59b2-40b8-869d-e10284a05879 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:31.125726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12c5b-59b2-40b8-869d-e10284a05879 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/c40d0702d56d47b48afc200b4de3027f/roles/800436bc9e734eb38844e9544c3dc7bc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:31.125884 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:31.126118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:31.126393 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:31.127237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:31.127538 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:31.128999 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:31.143256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa12c5b-59b2-40b8-869d-e10284a05879 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=c40d0702d56d47b48afc200b4de3027f, role_id=800436bc9e734eb38844e9544c3dc7bc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:31.144852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa12c5b-59b2-40b8-869d-e10284a05879 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:31.164904 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 290/589] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:59:30 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/c40d0702d56d47b48afc200b4de3027f/roles/800436bc9e734eb38844e9544c3dc7bc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:59:31.165138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 300/590] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 13:59:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:31.165138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:31.165366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa12c5b-59b2-40b8-869d-e10284a05879 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:31.311373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa12c5b-59b2-40b8-869d-e10284a05879 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:31.323920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad8b9a-cbfc-4505-888a-c2599d522dc4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:31.359837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:31.360496 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:31.360824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:31.361104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:31.361910 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:31.362222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:31.363633 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:31.375979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:31.377084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:31.377650 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 291/591] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:31.378557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:31.382188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:31.382618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:31.384524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:31.384867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:31.386363 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:31.405479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 301/592] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:31.406303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:31.533444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87449c3c-3050-41bf-a248-ed37db5c27ff None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:31.582800 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:31.583716 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:31.584008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:31.584501 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:31.606351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:31.607462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63ee7f-f1fc-4dfd-b64c-9decd23a778e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:31.607851 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:31.642532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:31.643448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:31.644322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:31.644322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:31.644322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:31.644322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:31.646724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 292/593] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:31.648280 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:31.675068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:31.678232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:31.678661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:31.679083 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:31.696503 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:31.699652 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:31.727188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:31.729060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 13:59:31.730865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:31.735708 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 302/594] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:31.737874 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:31.860173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bef95-f984-49c6-ad18-5c78c89bf7db None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:31.875137 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f324d-667d-42e0-8676-ad26cc34cbf9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:31.904590 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:31.906157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:31.906157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:31.906378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:31.912701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:31.912701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:31.912701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:31.923179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 303/595] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:31.924213 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:31.944309 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:31.944518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:31.944894 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:31.945431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:31.959313 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:31.962264 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:31.992976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:31.993938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:31.994841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:31.994841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:31.994841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:31.994841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:31.994841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:31.994841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:31.994841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:31.994841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:32.001075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 293/596] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:32.002719 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:32.037439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c7f1f-182d-4880-8b5d-10b074f279f7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:32.074877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:32.075561 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.075845 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.076122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.077024 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:32.077332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:32.078972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:32.099954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 304/597] 10.222.0.13 () {56 vars in 1139 bytes} [Mon May 16 13:59:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:32.100948 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:32.159749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16eb46-f42a-4115-a910-5e120b627d3d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:32.200240 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0257d1-1208-494b-bbb1-98c42bfba811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:32.201247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0257d1-1208-494b-bbb1-98c42bfba811 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.201568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0257d1-1208-494b-bbb1-98c42bfba811 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.201833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0257d1-1208-494b-bbb1-98c42bfba811 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.210460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0257d1-1208-494b-bbb1-98c42bfba811 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:32.211945 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0257d1-1208-494b-bbb1-98c42bfba811 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ab0257d1-1208-494b-bbb1-98c42bfba811 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:32.228103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:32.229425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:32.230721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 294/598] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:32.231989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584770f-8d99-4ec1-84b4-36cd55d3d0c9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.232132 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584770f-8d99-4ec1-84b4-36cd55d3d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.232628 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584770f-8d99-4ec1-84b4-36cd55d3d0c9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.239991 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 295/599] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:32.239991 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584770f-8d99-4ec1-84b4-36cd55d3d0c9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:32.242399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61709b2d-4d2f-44bc-acf4-5b1f494a3711 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:32.290544 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:32.291220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.291521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.291797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.292589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:32.292925 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:32.294421 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:32.307823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 305/600] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:32.308716 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:32.391066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584770f-8d99-4ec1-84b4-36cd55d3d0c9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:32.431001 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f65867-ed8f-45ce-884a-5b7d43f67ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:32.431728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65867-ed8f-45ce-884a-5b7d43f67ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.432010 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65867-ed8f-45ce-884a-5b7d43f67ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.432290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65867-ed8f-45ce-884a-5b7d43f67ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.445065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f65867-ed8f-45ce-884a-5b7d43f67ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:32.446709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f65867-ed8f-45ce-884a-5b7d43f67ba5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:32.460251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa576516-8f44-477d-b5e3-024a6838b406 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-08f65867-ed8f-45ce-884a-5b7d43f67ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:32.468209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:32.470238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:32.471985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:32.471985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:32.471985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:32.471985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:32.471985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 296/601] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:32.471985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae6953-9ef6-45f4-9cec-e61640254efb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.471985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae6953-9ef6-45f4-9cec-e61640254efb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.471985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae6953-9ef6-45f4-9cec-e61640254efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.493889 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4dae6953-9ef6-45f4-9cec-e61640254efb None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:32.495199 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4dae6953-9ef6-45f4-9cec-e61640254efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:32.525292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:32.526440 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.526922 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.527400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.528984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:32.529514 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:32.532327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:32.564502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 306/602] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:32.564502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:32.596395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 297/603] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:32.599156 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae6953-9ef6-45f4-9cec-e61640254efb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:32.721472 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca8f84-4115-426b-835c-91b10dad6e5f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:32.772695 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71bd36-e76b-4c6b-830b-0718927ae318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:32.773796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71bd36-e76b-4c6b-830b-0718927ae318 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.774376 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71bd36-e76b-4c6b-830b-0718927ae318 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.774687 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71bd36-e76b-4c6b-830b-0718927ae318 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/6c6aec0d7c7d4904a07bb4b812514701/roles/800436bc9e734eb38844e9544c3dc7bc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.782608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae6953-9ef6-45f4-9cec-e61640254efb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:32.792930 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71bd36-e76b-4c6b-830b-0718927ae318 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=6c6aec0d7c7d4904a07bb4b812514701, role_id=800436bc9e734eb38844e9544c3dc7bc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:32.794617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71bd36-e76b-4c6b-830b-0718927ae318 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:32.815283 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 307/604] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:59:32 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/6c6aec0d7c7d4904a07bb4b812514701/roles/800436bc9e734eb38844e9544c3dc7bc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:59:32.816661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71bd36-e76b-4c6b-830b-0718927ae318 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:32.837564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:32.839084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:32.839844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:32.840858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:32.842491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:32.843294 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:32.846386 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:32.873253 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 298/605] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:32.875120 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:33.032131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71bd36-e76b-4c6b-830b-0718927ae318 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:33.060135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddf9d3-4c7a-4cdd-8263-7ff44bd4a289 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:33.096142 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff7e59-7c5b-4b2e-a932-10b35e68f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:33.097850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7e59-7c5b-4b2e-a932-10b35e68f4d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:33.098421 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7e59-7c5b-4b2e-a932-10b35e68f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:33.099167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff7e59-7c5b-4b2e-a932-10b35e68f4d8 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/7821fd86364744bf9d79e03d32b749fe/roles/800436bc9e734eb38844e9544c3dc7bc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:33.126790 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865a97-6af2-48f0-910f-a7fd6eaba3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:33.127364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff7e59-7c5b-4b2e-a932-10b35e68f4d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=7821fd86364744bf9d79e03d32b749fe, role_id=800436bc9e734eb38844e9544c3dc7bc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:33.128720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865a97-6af2-48f0-910f-a7fd6eaba3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:33.129555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865a97-6af2-48f0-910f-a7fd6eaba3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:33.130759 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff7e59-7c5b-4b2e-a932-10b35e68f4d8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:33.131116 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865a97-6af2-48f0-910f-a7fd6eaba3a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:33.150630 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97865a97-6af2-48f0-910f-a7fd6eaba3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:33.157078 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 308/606] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:59:32 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/7821fd86364744bf9d79e03d32b749fe/roles/800436bc9e734eb38844e9544c3dc7bc => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:59:33.158443 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff7e59-7c5b-4b2e-a932-10b35e68f4d8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-97865a97-6af2-48f0-910f-a7fd6eaba3a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:33.160366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:33.161993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:33.162976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:33.165402 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 299/607] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:33.182575 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865a97-6af2-48f0-910f-a7fd6eaba3a9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:33.325678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff7e59-7c5b-4b2e-a932-10b35e68f4d8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:33.377072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:33.377887 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:33.378177 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:33.378428 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:33.386865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:33.388428 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:33.404550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:33.406333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:33.408117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 309/608] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:33.419745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:33.432629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865a97-6af2-48f0-910f-a7fd6eaba3a9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:33.514200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:33.514887 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:33.515158 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:33.515423 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:33.516170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:33.516465 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:33.518555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:33.528373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 300/609] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:33.536769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:33.621229 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37804ea-9c4b-43d9-805d-fb0e042beedf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:33.650324 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04659f-af81-4078-ae2f-675fc784b223 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:33.681800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:33.683177 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:33.683757 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:33.684329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:33.686288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:33.686600 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:33.687017 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:33.687790 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:33.688254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:33.688718 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:33.690363 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:33.701380 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:33.703111 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:33.714630 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 310/610] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:33.721547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:33.722460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:33.724122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:33.724122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:33.724122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:33.724122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:33.725068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:33.726470 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 301/611] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:33.735305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:33.884870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d9944-1fd2-4f24-bee8-12ad07466b64 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:33.908372 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c250403-8002-4e2c-a944-014582f8f782 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:33.936262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:33.937286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:33.937746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:33.938196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:33.945291 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:33.952703 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:33.952703 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:33.972393 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7aef-4785-41c7-adba-c910b6f8e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:33.974910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7aef-4785-41c7-adba-c910b6f8e538 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:33.975487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7aef-4785-41c7-adba-c910b6f8e538 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:33.976063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7aef-4785-41c7-adba-c910b6f8e538 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/4c352582d4014e008ff92350808c84f9/roles/800436bc9e734eb38844e9544c3dc7bc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:33.993554 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 302/612] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:34.001809 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:34.003112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7aef-4785-41c7-adba-c910b6f8e538 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=4c352582d4014e008ff92350808c84f9, role_id=800436bc9e734eb38844e9544c3dc7bc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:34.006016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7aef-4785-41c7-adba-c910b6f8e538 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:34.032475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 311/613] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:59:33 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/4c352582d4014e008ff92350808c84f9/roles/800436bc9e734eb38844e9544c3dc7bc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 13:59:34.219695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e90177-5d54-4796-b08d-fd1a2215297c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:34.288435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:34.289767 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:34.290297 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:34.290745 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:34.310070 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:34.311571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:34.335787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:34.337663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:34.339466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:34.344047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 303/614] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:34.352823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7aef-4785-41c7-adba-c910b6f8e538 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:34.584034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7aef-4785-41c7-adba-c910b6f8e538 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:34.652000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7e44a-cb46-4335-8b4d-d9e00c0aedaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:34.653238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e44a-cb46-4335-8b4d-d9e00c0aedaf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:34.653743 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e44a-cb46-4335-8b4d-d9e00c0aedaf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:34.654253 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e44a-cb46-4335-8b4d-d9e00c0aedaf None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:34.655996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7e44a-cb46-4335-8b4d-d9e00c0aedaf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:34.656560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7e44a-cb46-4335-8b4d-d9e00c0aedaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:34.659432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7e44a-cb46-4335-8b4d-d9e00c0aedaf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:34.699171 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 312/615] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 13:59:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:34.709316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:34.902742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b948fb-b30e-40fa-a625-e4e7c3618d43 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:34.902742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b948fb-b30e-40fa-a625-e4e7c3618d43 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:34.903110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b948fb-b30e-40fa-a625-e4e7c3618d43 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:34.904517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 313/616] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:59:34.914000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd594cf4-0d5e-49b2-bfda-846f324cc084 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:34.914000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd594cf4-0d5e-49b2-bfda-846f324cc084 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:34.914000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd594cf4-0d5e-49b2-bfda-846f324cc084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:34.928750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9e160-e5be-44d2-8084-d97904c28e1a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:34.954766 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bd594cf4-0d5e-49b2-bfda-846f324cc084 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:34.963490 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bd594cf4-0d5e-49b2-bfda-846f324cc084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:34.970256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:34.971355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:34.977301 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:34.977830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:34.997939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:35.000826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:35.028214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:35.029290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:35.030304 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:35.030304 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:35.030304 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:35.030304 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:35.032236 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 304/617] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:35.042924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:35.112447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 314/618] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:35.198756 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1796f8-e52b-4d1b-b5b9-8cba97f0b45e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:35.209837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd594cf4-0d5e-49b2-bfda-846f324cc084 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:35.236756 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:35.237737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:35.238172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:35.238599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:35.240050 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:35.240516 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:35.242103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:35.255838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 305/619] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:35.265490 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:35.390880 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd594cf4-0d5e-49b2-bfda-846f324cc084 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:35.464171 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194c08-5292-4094-ae7b-6af008608c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:35.464937 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194c08-5292-4094-ae7b-6af008608c8e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:35.465214 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194c08-5292-4094-ae7b-6af008608c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:35.465484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194c08-5292-4094-ae7b-6af008608c8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:35.467812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d057a-485e-4e32-9ae4-fae61c0c4297 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:35.493417 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a194c08-5292-4094-ae7b-6af008608c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4a194c08-5292-4094-ae7b-6af008608c8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:35.514447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:35.515458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:35.516302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 315/620] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:35.524749 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194c08-5292-4094-ae7b-6af008608c8e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:35.540236 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:35.541475 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:35.541967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:35.548705 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:35.557433 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:35.559394 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:35.586985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:35.587944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:35.588886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:35.588886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:35.588886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:35.588886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:35.588886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:35.588886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:35.588886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:35.588886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:35.591183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 306/621] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:35.600293 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:35.631988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194c08-5292-4094-ae7b-6af008608c8e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:35.667962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:35.668648 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:35.668957 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:35.669229 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:35.669984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:35.670637 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:35.671663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:35.681867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 316/622] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:35.689669 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:35.826294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b19cc-9e09-4c6a-b2d0-5692b0636ca8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:35.861646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:35.862449 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:35.862725 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:35.862998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:35.872914 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c731-28e8-43ef-85b4-70e00faef8ba None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:35.874714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:35.876289 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:35.895594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:35.896617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:35.897550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:35.897550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:35.897550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:35.897550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:35.897550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 317/623] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:35.904652 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:35.993392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:35.994480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:35.994979 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:35.995461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:35.996497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:35.997042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:35.998789 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:36.026395 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166d901-83f8-4ebc-a580-17bd5c9b5bee None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:36.029472 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 307/624] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:36.035044 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:36.066436 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:36.067155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:36.067423 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:36.067696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:36.068430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:36.068764 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:36.072711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:36.088930 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 318/625] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:36.090968 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:36.231072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93bd6-648a-4bde-bf25-c680fa045bf7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:36.251946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a0ed-549a-4e72-83e9-8f76eed2b56f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:36.310829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:36.311640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:36.311909 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:36.312196 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:36.326440 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:36.327916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:36.330871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627535a-fc18-4262-9ff7-011626eb9794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:36.331782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627535a-fc18-4262-9ff7-011626eb9794 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:36.332058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627535a-fc18-4262-9ff7-011626eb9794 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:36.332328 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627535a-fc18-4262-9ff7-011626eb9794 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/0734d46e1f4c4994a03d56f0591dfded/roles/800436bc9e734eb38844e9544c3dc7bc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:36.358655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:36.359631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:36.360552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:36.365839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 319/626] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 13:59:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:36.366779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:36.368012 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627535a-fc18-4262-9ff7-011626eb9794 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=0734d46e1f4c4994a03d56f0591dfded, role_id=800436bc9e734eb38844e9544c3dc7bc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:36.369523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627535a-fc18-4262-9ff7-011626eb9794 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:36.391505 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 308/627] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:59:36 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/0734d46e1f4c4994a03d56f0591dfded/roles/800436bc9e734eb38844e9544c3dc7bc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 13:59:36.535245 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf332-5e17-4ca7-a52e-970d966e215a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:36.602449 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba150e99-b2ec-4172-aa4c-86d513222d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:36.603387 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150e99-b2ec-4172-aa4c-86d513222d71 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:36.603667 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150e99-b2ec-4172-aa4c-86d513222d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:36.603932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150e99-b2ec-4172-aa4c-86d513222d71 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:36.604812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba150e99-b2ec-4172-aa4c-86d513222d71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:36.605116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba150e99-b2ec-4172-aa4c-86d513222d71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:36.606592 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba150e99-b2ec-4172-aa4c-86d513222d71 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:36.636616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 320/628] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 13:59:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:36.642345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627535a-fc18-4262-9ff7-011626eb9794 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:36.690180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63688f09-c406-4493-9b50-1821164e6081 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:36.690524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63688f09-c406-4493-9b50-1821164e6081 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:36.690711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63688f09-c406-4493-9b50-1821164e6081 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:36.694397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 321/629] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:59:36.699217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64d10-3009-429b-86d5-45057e55e44d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:36.699519 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64d10-3009-429b-86d5-45057e55e44d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:36.699842 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64d10-3009-429b-86d5-45057e55e44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:36.718413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-92d64d10-3009-429b-86d5-45057e55e44d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:36.719635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-92d64d10-3009-429b-86d5-45057e55e44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:36.800852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 322/630] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:36.821330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d64d10-3009-429b-86d5-45057e55e44d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:36.856801 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627535a-fc18-4262-9ff7-011626eb9794 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:36.931231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54c52-0db0-4654-8252-d475ec32d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:36.932266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54c52-0db0-4654-8252-d475ec32d90a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:36.932548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54c52-0db0-4654-8252-d475ec32d90a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:36.932860 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54c52-0db0-4654-8252-d475ec32d90a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:36.956538 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d64d10-3009-429b-86d5-45057e55e44d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:36.999185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d48d31-5bdf-4ac4-bce9-b7d3a8075848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:37.000070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d48d31-5bdf-4ac4-bce9-b7d3a8075848 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.000355 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d48d31-5bdf-4ac4-bce9-b7d3a8075848 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.000628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d48d31-5bdf-4ac4-bce9-b7d3a8075848 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.014107 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d48d31-5bdf-4ac4-bce9-b7d3a8075848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-87d48d31-5bdf-4ac4-bce9-b7d3a8075848 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:37.022985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:37.023996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:37.030051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 323/631] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:37.032776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d48d31-5bdf-4ac4-bce9-b7d3a8075848 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:37.049048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54c52-0db0-4654-8252-d475ec32d90a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:37.050556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54c52-0db0-4654-8252-d475ec32d90a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:37.155850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d48d31-5bdf-4ac4-bce9-b7d3a8075848 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:37.203036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:37.204068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.204546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.205034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.206003 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:37.206503 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:37.208342 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:37.235830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 324/632] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:37.250195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:37.320801 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 309/633] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:37.322479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54c52-0db0-4654-8252-d475ec32d90a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:37.448506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54c52-0db0-4654-8252-d475ec32d90a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:37.476021 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329b1f4-a132-4014-874d-681f997d012d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:37.506106 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee2d7c-ea57-4122-8c70-c73d26cc7a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:37.507105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee2d7c-ea57-4122-8c70-c73d26cc7a43 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.507390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee2d7c-ea57-4122-8c70-c73d26cc7a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.508045 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee2d7c-ea57-4122-8c70-c73d26cc7a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.515606 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eed635-e6a7-4334-be16-a1ed1aa1de96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:37.516411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed635-e6a7-4334-be16-a1ed1aa1de96 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.516711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed635-e6a7-4334-be16-a1ed1aa1de96 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.517013 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed635-e6a7-4334-be16-a1ed1aa1de96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.522042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee2d7c-ea57-4122-8c70-c73d26cc7a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:37.523511 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee2d7c-ea57-4122-8c70-c73d26cc7a43 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:37.529488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eed635-e6a7-4334-be16-a1ed1aa1de96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:37.530962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eed635-e6a7-4334-be16-a1ed1aa1de96 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b8ee2d7c-ea57-4122-8c70-c73d26cc7a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:37.546351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:37.547319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:37.548634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:37.548634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:37.548634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:37.548634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:37.548634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 310/634] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:37.550217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963831b4-8f62-4e73-8f5e-a117deb3c31f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.550217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963831b4-8f62-4e73-8f5e-a117deb3c31f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f4eed635-e6a7-4334-be16-a1ed1aa1de96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:37.550433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:37.552665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:37.554922 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:37.554922 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:37.554922 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:37.554922 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:37.555426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963831b4-8f62-4e73-8f5e-a117deb3c31f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.555570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 325/635] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:37.555709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 311/636] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:37.560202 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66526860-2242-4414-9cdb-057617199652 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.560202 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66526860-2242-4414-9cdb-057617199652 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.560202 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66526860-2242-4414-9cdb-057617199652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.562136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963831b4-8f62-4e73-8f5e-a117deb3c31f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:37.578707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-66526860-2242-4414-9cdb-057617199652 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:37.579915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-66526860-2242-4414-9cdb-057617199652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:37.669364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 326/637] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:37.670859 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66526860-2242-4414-9cdb-057617199652 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:37.728241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963831b4-8f62-4e73-8f5e-a117deb3c31f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:37.791561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c1ff-29d9-4f2f-9e29-e2f370fc9586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:37.792608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c1ff-29d9-4f2f-9e29-e2f370fc9586 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.793073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c1ff-29d9-4f2f-9e29-e2f370fc9586 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.793560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c1ff-29d9-4f2f-9e29-e2f370fc9586 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.794498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c1ff-29d9-4f2f-9e29-e2f370fc9586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:37.794979 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c1ff-29d9-4f2f-9e29-e2f370fc9586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:37.796599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c1ff-29d9-4f2f-9e29-e2f370fc9586 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:37.810495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 312/638] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:37.812164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc6d5-7a8b-4338-9cf9-6f8ceadfd89d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.812666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc6d5-7a8b-4338-9cf9-6f8ceadfd89d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.813163 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc6d5-7a8b-4338-9cf9-6f8ceadfd89d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.815104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 313/639] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:37.816166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc6d5-7a8b-4338-9cf9-6f8ceadfd89d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:37.830615 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66526860-2242-4414-9cdb-057617199652 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:37.885956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:37.887127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:37.887616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:37.888092 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:37.889531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:37.890084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:37.892695 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:37.913645 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 327/640] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:37.914865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:38.004298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc6d5-7a8b-4338-9cf9-6f8ceadfd89d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:38.050638 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26704cbb-3c21-4f32-979d-e682d69d551a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:38.067927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca370cd4-01d7-4234-a48d-75e741c86072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:38.069511 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370cd4-01d7-4234-a48d-75e741c86072 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.069999 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370cd4-01d7-4234-a48d-75e741c86072 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.070481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca370cd4-01d7-4234-a48d-75e741c86072 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.090812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca370cd4-01d7-4234-a48d-75e741c86072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:38.095385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:38.096186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.096510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.096804 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.105521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:38.106982 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ca370cd4-01d7-4234-a48d-75e741c86072 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:38.107133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:38.108629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:38.110211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 314/641] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:38.112496 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdffac-b2fb-4f0e-b6e5-d16052e2ff2e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.112496 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdffac-b2fb-4f0e-b6e5-d16052e2ff2e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.112996 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdffac-b2fb-4f0e-b6e5-d16052e2ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:38.130392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:38.135233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 328/642] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:38.138403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:38.143823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-43cdffac-b2fb-4f0e-b6e5-d16052e2ff2e None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:38.145233 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-43cdffac-b2fb-4f0e-b6e5-d16052e2ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:38.237079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 315/643] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:38.237079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdffac-b2fb-4f0e-b6e5-d16052e2ff2e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:38.254697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef01e7-fb5a-4fd3-a316-776cfbb16c56 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:38.294470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:38.295288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.295566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.295834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.305000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:38.306498 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:38.323681 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:38.325742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 13:59:38.327569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:38.329825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 329/644] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:38.330537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:38.370887 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdffac-b2fb-4f0e-b6e5-d16052e2ff2e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:38.408540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:38.409291 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.409576 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.409854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.410644 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:38.411515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:38.413455 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:38.423349 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 316/645] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:38.424614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:38.475599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c282dc-2ed0-4ae4-a567-99f3e32f043d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:38.522880 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:38.523458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.523730 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.524008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.524888 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:38.525194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:38.526726 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:38.544733 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 330/646] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:38.544733 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:38.551336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c50e76-2a94-4a83-bed3-87c372f3db75 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:38.610104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61260210-54c0-4e7e-a68d-15b7bb7f3d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:38.611531 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61260210-54c0-4e7e-a68d-15b7bb7f3d45 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.612037 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61260210-54c0-4e7e-a68d-15b7bb7f3d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.612540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61260210-54c0-4e7e-a68d-15b7bb7f3d45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.629232 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61260210-54c0-4e7e-a68d-15b7bb7f3d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-61260210-54c0-4e7e-a68d-15b7bb7f3d45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:38.637722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:38.639625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 317/647] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:38.642047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61260210-54c0-4e7e-a68d-15b7bb7f3d45 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:38.736889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35bc13-c8d7-4716-8508-03e0636708ae None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:38.776498 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:38.777952 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.778619 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.778804 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61260210-54c0-4e7e-a68d-15b7bb7f3d45 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:38.779460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.781220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:38.781730 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:38.784222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:38.814029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 331/648] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 13:59:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:38.815372 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:38.840006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:38.841431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:38.841753 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:38.842007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:38.982420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:38.985218 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:39.006246 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417c48a-2d38-430b-9f3b-4948ef1f22e6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:39.019252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:39.021196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:39.022093 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:39.022093 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:39.022093 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:39.022093 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:39.029695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 318/649] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:39.031231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:39.056377 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:39.057383 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:39.057664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:39.057910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:39.058740 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=c40d0702d56d47b48afc200b4de3027f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:39.059104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:39.060576 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:39.074024 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 332/650] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:38 2022] GET /identity/v3/role_assignments?user.id=c40d0702d56d47b48afc200b4de3027f&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:39.074024 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:39.185300 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baff8fa-b8ca-4160-9c7e-f1e25038b963 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:39.226006 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2b341-a5c1-4b0e-a7ed-174e437f3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:39.226595 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e603145-e803-40bd-9dd2-e978b3814a7f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:39.226779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2b341-a5c1-4b0e-a7ed-174e437f3500 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:39.226913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2b341-a5c1-4b0e-a7ed-174e437f3500 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:39.227183 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2b341-a5c1-4b0e-a7ed-174e437f3500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:39.290889 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:39.291963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:39.292450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:39.292961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:39.294399 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:39.294928 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:39.297614 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:39.304721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2b341-a5c1-4b0e-a7ed-174e437f3500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:39.307358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2b341-a5c1-4b0e-a7ed-174e437f3500 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:39.313737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 319/651] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:39.314974 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:39.435966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 333/652] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:39.437931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2b341-a5c1-4b0e-a7ed-174e437f3500 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:39.501731 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f5306-4b11-4d07-8333-c11ac14994f0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:39.549322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:39.551131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:39.551761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:39.552254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:39.553697 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:39.554268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:39.556964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:39.579899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 320/653] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:39.585626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:39.610743 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2b341-a5c1-4b0e-a7ed-174e437f3500 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:39.675178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:39.676590 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:39.677668 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:39.678157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:39.698694 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:39.701567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:39.736132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:39.737542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:39.738424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:39.738424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:39.738424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:39.738424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:39.744070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 334/654] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:39.745089 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:39.781660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6c5c8-84bc-4e85-aa8a-2675d0ffd01a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:39.844508 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:39.845852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:39.846356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:39.846921 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:39.853220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0a29-b735-4afc-b93f-b07ae096b38b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:39.868173 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:39.870854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:39.890297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:39.891118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:39.891400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:39.891674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:39.900212 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:39.901727 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:39.911081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:39.912208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:39.913227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:39.913227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:39.913227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:39.913227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:39.913725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 321/655] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:39.915207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:39.922360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:39.923349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:39.924467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 335/656] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:39.926190 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:40.063897 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbb4c-536a-47c8-b59c-2937671c7b66 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:40.093610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9194f-4af9-415a-b7b6-4dd296f2b406 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:40.126015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:40.127178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.127664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.128140 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.129547 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:40.131167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:40.133711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:40.144908 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585631ed-568e-47ef-913f-195907d8a69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:40.146305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585631ed-568e-47ef-913f-195907d8a69c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.146796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585631ed-568e-47ef-913f-195907d8a69c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.147201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585631ed-568e-47ef-913f-195907d8a69c None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.148473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585631ed-568e-47ef-913f-195907d8a69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:40.148932 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585631ed-568e-47ef-913f-195907d8a69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:40.150917 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585631ed-568e-47ef-913f-195907d8a69c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:40.155288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 336/657] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:40.156542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:40.185272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 322/658] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:40.185272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b6725-ad51-4519-8a91-ded4e5301f82 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.185272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b6725-ad51-4519-8a91-ded4e5301f82 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.185272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b6725-ad51-4519-8a91-ded4e5301f82 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.185272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 323/659] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:40.185272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b6725-ad51-4519-8a91-ded4e5301f82 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:40.325428 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942c5a-6f43-4953-a99f-bc82698bcfa3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:40.361870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b6725-ad51-4519-8a91-ded4e5301f82 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:40.384975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:40.385849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.386311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.386722 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.388037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:40.388506 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:40.390347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:40.422028 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 337/660] 10.222.0.13 () {56 vars in 1139 bytes} [Mon May 16 13:59:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:40.422028 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:40.430610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793f024-2227-4dd5-a146-a452c3f28fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:40.432223 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793f024-2227-4dd5-a146-a452c3f28fee None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.432752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793f024-2227-4dd5-a146-a452c3f28fee None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.433239 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793f024-2227-4dd5-a146-a452c3f28fee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.447046 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793f024-2227-4dd5-a146-a452c3f28fee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:40.449968 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793f024-2227-4dd5-a146-a452c3f28fee None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f793f024-2227-4dd5-a146-a452c3f28fee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:40.479289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:40.481038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:40.482782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 324/661] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:40.484552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e6cda-3cb1-4173-a43e-78746e260e50 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.484851 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e6cda-3cb1-4173-a43e-78746e260e50 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.485200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e6cda-3cb1-4173-a43e-78746e260e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.515635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-df7e6cda-3cb1-4173-a43e-78746e260e50 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:40.517778 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-df7e6cda-3cb1-4173-a43e-78746e260e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:40.571810 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d71fe-f0df-4005-8642-80432a6b15bd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:40.614933 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:40.616110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.616541 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.616992 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] PATH_INFO: `/v3/users/glance` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.626018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:40.627773 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:40.640458 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 325/662] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:40.641819 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e6cda-3cb1-4173-a43e-78746e260e50 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:40.651068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:40.652971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:40.655674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 338/663] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:40.657673 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:40.807812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e6cda-3cb1-4173-a43e-78746e260e50 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:40.821299 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0db2d-bbed-4490-8ac0-5fc0efaeb0ef None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:40.850313 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6aed6-cc21-4c8c-936c-7adab2858d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:40.851170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6aed6-cc21-4c8c-936c-7adab2858d98 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.851641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6aed6-cc21-4c8c-936c-7adab2858d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.852012 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6aed6-cc21-4c8c-936c-7adab2858d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.882334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:40.883339 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:40.883788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:40.884233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:40.885679 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:40.886323 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:40.888895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:40.912811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 339/664] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:40.912811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:40.957768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6aed6-cc21-4c8c-936c-7adab2858d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:40.960693 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6aed6-cc21-4c8c-936c-7adab2858d98 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:41.058605 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0f70-4f49-4f25-afe2-b8f707b1f71f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:41.103105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 326/665] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:41.104475 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6aed6-cc21-4c8c-936c-7adab2858d98 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:41.121026 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:41.122432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:41.122874 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:41.123284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:41.124708 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:41.125236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:41.127665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:41.159860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 340/666] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 13:59:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:41.162762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:41.234675 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6aed6-cc21-4c8c-936c-7adab2858d98 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:41.278585 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a234c82-0349-47ea-96b0-a7907f2594c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:41.279642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a234c82-0349-47ea-96b0-a7907f2594c6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:41.280067 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a234c82-0349-47ea-96b0-a7907f2594c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:41.280461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a234c82-0349-47ea-96b0-a7907f2594c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:41.293066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a234c82-0349-47ea-96b0-a7907f2594c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5a234c82-0349-47ea-96b0-a7907f2594c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:41.302326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:41.304550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:41.306176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 327/667] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:41.310763 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a234c82-0349-47ea-96b0-a7907f2594c6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:41.350688 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fface1c8-fc0f-428b-9637-6259a9ba95e8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:41.390828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:41.392086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:41.392601 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:41.393131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:41.394349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=7821fd86364744bf9d79e03d32b749fe) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:41.395223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:41.397712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:41.413009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 341/668] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:41 2022] GET /identity/v3/role_assignments?user.id=7821fd86364744bf9d79e03d32b749fe&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:41.413009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:41.488424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a234c82-0349-47ea-96b0-a7907f2594c6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:41.576088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:41.577585 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:41.578081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:41.578577 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:41.605205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b317-7fef-4cc8-8ac0-d71ec200963f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:41.606360 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:41.609597 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:41.652244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:41.654049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:41.655659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:41.655659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:41.655659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:41.655659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:41.658849 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 328/669] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:41.660588 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:41.685406 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0df92-2e70-4615-90ba-55735921f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:41.686793 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0df92-2e70-4615-90ba-55735921f3fd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:41.687411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0df92-2e70-4615-90ba-55735921f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:41.687986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0df92-2e70-4615-90ba-55735921f3fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:41.829298 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0df92-2e70-4615-90ba-55735921f3fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:41.832215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0df92-2e70-4615-90ba-55735921f3fd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:41.864004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89fa76-99fe-4829-b000-8dc9b408057f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:41.926506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:41.927489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:41.927939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:41.928422 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:41.929954 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:41.930635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:41.933021 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:41.948710 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 329/670] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:41.950088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:42.035315 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 342/671] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:42.038076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0df92-2e70-4615-90ba-55735921f3fd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:42.138979 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05498-289e-4b50-9807-77c0eb166790 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:42.201794 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:42.202810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:42.203289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:42.203757 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:42.205123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:42.205654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:42.209340 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:42.232733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 330/672] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:42.233269 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:42.251328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0df92-2e70-4615-90ba-55735921f3fd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:42.320897 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:42.322307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:42.322824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:42.323361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:42.353356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:42.356631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:42.392178 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:42.394222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:42.396230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:42.396230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:42.396230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:42.396230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:42.401233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 343/673] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:42.402900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:42.464103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381253f-40d1-4bd7-bc44-b0ade471023c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:42.532067 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:42.533826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:42.534592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:42.535437 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:42.557521 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:42.560594 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:42.596515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:42.599066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:42.601379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:42.601379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:42.601379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:42.601379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:42.602700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfbdaf-24ba-45ba-8607-d269b2cb628d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:42.604898 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 331/674] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:42.606631 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:42.676104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:42.678867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:42.679364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:42.679867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:42.694241 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:42.697136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:42.725435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:42.727186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:42.729039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 344/675] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:42.730027 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:42.748158 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a85b0-442d-4599-a66c-71c7c1126f22 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:42.806499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4204078-c7da-42d7-b537-39cdf46343b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:42.807549 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204078-c7da-42d7-b537-39cdf46343b6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:42.808003 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204078-c7da-42d7-b537-39cdf46343b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:42.808451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204078-c7da-42d7-b537-39cdf46343b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:42.809477 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4204078-c7da-42d7-b537-39cdf46343b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:42.809977 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4204078-c7da-42d7-b537-39cdf46343b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:42.812212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4204078-c7da-42d7-b537-39cdf46343b6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:42.836725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 332/676] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:42.836725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ba84-2e18-48e1-8921-91504ad69d65 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:42.836725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ba84-2e18-48e1-8921-91504ad69d65 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:42.836725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ba84-2e18-48e1-8921-91504ad69d65 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:42.836725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 333/677] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:42.838008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ba84-2e18-48e1-8921-91504ad69d65 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:42.904378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ec3b-4ea3-4ac8-94d9-693aa2f6e227 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:42.972970 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:42.975933 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:42.976369 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:42.976884 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:42.978938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:42.979478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:42.983185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:43.004059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 345/678] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:43.005775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:43.023529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ba84-2e18-48e1-8921-91504ad69d65 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:43.075471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d866f5-a881-4f32-b301-0fd5d6b7c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:43.076487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d866f5-a881-4f32-b301-0fd5d6b7c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:43.076922 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d866f5-a881-4f32-b301-0fd5d6b7c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:43.077394 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d866f5-a881-4f32-b301-0fd5d6b7c8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:43.078834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d866f5-a881-4f32-b301-0fd5d6b7c8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:43.079251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d866f5-a881-4f32-b301-0fd5d6b7c8f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:43.081807 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d866f5-a881-4f32-b301-0fd5d6b7c8f9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:43.110063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 334/679] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:43.110063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407868-7e89-4434-97ae-5cb746c37cef None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:43.110063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407868-7e89-4434-97ae-5cb746c37cef None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:43.110063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407868-7e89-4434-97ae-5cb746c37cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:43.130494 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-65407868-7e89-4434-97ae-5cb746c37cef None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:43.132486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-65407868-7e89-4434-97ae-5cb746c37cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:43.178020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d441e-ae2d-4764-ae8b-55274bf0884d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:43.233672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:43.235234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:43.235870 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:43.236601 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:43.241973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 335/680] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:43.243577 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65407868-7e89-4434-97ae-5cb746c37cef None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:43.259458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:43.261328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:43.280079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:43.281998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:43.283912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:43.287386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 346/681] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:43.287968 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:43.434322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65407868-7e89-4434-97ae-5cb746c37cef None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:43.435195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3f39-a54f-4b67-a3c5-0d6b77b263a2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:43.484289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:43.484564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:43.485058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:43.485247 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:43.485337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:43.485622 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:43.485825 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:43.486080 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:43.487701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=4c352582d4014e008ff92350808c84f9) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:43.488221 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:43.491451 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:43.495118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:43.496874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:43.501766 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 347/682] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:43 2022] GET /identity/v3/role_assignments?user.id=4c352582d4014e008ff92350808c84f9&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:43.502771 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:43.523436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:43.525231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:43.526873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:43.526873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:43.526873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:43.526873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:43.526873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:43.526873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:43.526873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:43.526873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:43.529123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 336/683] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:43.530110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:43.673454 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fe600-7316-4822-8c28-223e394a683f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:43.710614 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7915e6-195d-48e1-95b8-cfcf54fb1574 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:43.729005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:43.730873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:43.731787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:43.732426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:43.735300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:43.736309 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:43.740194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:43.759832 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecff50-9a51-4c3c-93b4-fb6068f2b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:43.760915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecff50-9a51-4c3c-93b4-fb6068f2b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:43.761396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecff50-9a51-4c3c-93b4-fb6068f2b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:43.761783 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecff50-9a51-4c3c-93b4-fb6068f2b0f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:43.783571 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecff50-9a51-4c3c-93b4-fb6068f2b0f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:43.788715 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 337/684] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 13:59:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:43.789930 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c2ecff50-9a51-4c3c-93b4-fb6068f2b0f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:43.800049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:43.802205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:43.803737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:43.807894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 348/685] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:43.809779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecff50-9a51-4c3c-93b4-fb6068f2b0f2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:43.962459 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecff50-9a51-4c3c-93b4-fb6068f2b0f2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:43.983858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a602-0125-4bd0-a311-895745b118fa None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:43.999457 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3e65-dee3-4409-a126-97c89a71f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:44.000127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3e65-dee3-4409-a126-97c89a71f78e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.000409 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3e65-dee3-4409-a126-97c89a71f78e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.000698 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3e65-dee3-4409-a126-97c89a71f78e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.046657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:44.047786 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.048258 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.048739 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.049761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:44.050114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:44.051961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:44.070222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 338/686] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:44.071377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:44.080236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c3e65-dee3-4409-a126-97c89a71f78e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:44.081731 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c3e65-dee3-4409-a126-97c89a71f78e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:44.198976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 349/687] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:44.199818 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3e65-dee3-4409-a126-97c89a71f78e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:44.238592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222581-24b7-404f-89d7-2be2165a5d4a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:44.300901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:44.302456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.302948 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.303567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.305077 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:44.305619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:44.309082 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:44.314819 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3e65-dee3-4409-a126-97c89a71f78e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:44.328174 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 339/688] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:44.329704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:44.365095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36178784-51de-4caa-9d35-cbfe7585e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:44.366529 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178784-51de-4caa-9d35-cbfe7585e34b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.367233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178784-51de-4caa-9d35-cbfe7585e34b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.368197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178784-51de-4caa-9d35-cbfe7585e34b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.371324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36178784-51de-4caa-9d35-cbfe7585e34b None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=6c6aec0d7c7d4904a07bb4b812514701) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:44.371324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36178784-51de-4caa-9d35-cbfe7585e34b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:44.372732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36178784-51de-4caa-9d35-cbfe7585e34b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:44.387276 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 350/689] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:44 2022] GET /identity/v3/role_assignments?user.id=6c6aec0d7c7d4904a07bb4b812514701&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:44.387276 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349f140-7226-4a29-a18d-59786a98309a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.387537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349f140-7226-4a29-a18d-59786a98309a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.389052 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349f140-7226-4a29-a18d-59786a98309a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.389519 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 351/690] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:44.392917 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349f140-7226-4a29-a18d-59786a98309a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:44.470907 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77cbcb-6dc4-4e96-89e6-d8d1ec525883 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:44.518640 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c202419-31f7-497c-9916-1f109505ce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:44.521951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202419-31f7-497c-9916-1f109505ce6f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.522829 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202419-31f7-497c-9916-1f109505ce6f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.523600 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202419-31f7-497c-9916-1f109505ce6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.549343 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c202419-31f7-497c-9916-1f109505ce6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:44.553031 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c202419-31f7-497c-9916-1f109505ce6f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:44.569675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349f140-7226-4a29-a18d-59786a98309a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8c202419-31f7-497c-9916-1f109505ce6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:44.596136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:44.597963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:44.600727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:44.600727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:44.600727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:44.600727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:44.604132 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 340/691] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:44.606729 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46067e-962f-4d0a-b3dc-14a42a865e12 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.607186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46067e-962f-4d0a-b3dc-14a42a865e12 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.607569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46067e-962f-4d0a-b3dc-14a42a865e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.637586 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-fa46067e-962f-4d0a-b3dc-14a42a865e12 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:44.639452 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fa46067e-962f-4d0a-b3dc-14a42a865e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:44.645437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:44.647450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.647870 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.648277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.670727 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:44.674888 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:44.712553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:44.714154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:44.715802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:44.715802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:44.715802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:44.715802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:44.715802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 352/692] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:44.716871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:44.767428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 341/693] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:44.771943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46067e-962f-4d0a-b3dc-14a42a865e12 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:44.913627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd326d1-5f96-4c73-b2a3-966eb41e1458 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:44.960396 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46067e-962f-4d0a-b3dc-14a42a865e12 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:44.970383 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:44.972992 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:44.975046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:44.976140 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:44.977988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:44.979350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:44.982967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.001785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:45.002620 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:45.003615 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:45.003939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:45.004805 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:45.005251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:45.007272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.011349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 353/694] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:45.013106 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.028842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 342/695] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:45.030024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.156257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df51e-a63f-471c-9bdb-1ca6d2eeaf3b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:45.193561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:45.194839 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:45.195658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:45.196110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:45.204770 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:45.204952 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6cce8-4457-4c8a-8f3e-85e5cd7bb8c2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:45.207008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:45.226389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:45.227368 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:45.228267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:45.228267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:45.228267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:45.228267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:45.228267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:45.228267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:45.228267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:45.228267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:45.231099 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 343/696] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:45.233501 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.268486 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:45.270129 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:45.270476 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:45.271994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:45.273402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:45.276078 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:45.304849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:45.305876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 13:59:45.306734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:45.313128 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 354/697] 10.222.0.13 () {56 vars in 1129 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:45.314642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.382278 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9bc0-c68e-412a-8dec-73836a78ca7b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:45.423030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ecedf-d9c6-4967-9840-4c5465e6c669 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:45.444571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:45.445878 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:45.446363 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:45.447293 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:45.461268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:45.462908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:45.463790 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:45.463896 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.464342 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:45.464840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:45.465845 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:45.466290 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:45.467915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.482304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 355/698] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:45.483414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:45.494024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:45.495244 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:45.496390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:45.505405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 344/699] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:45.507334 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.592458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61635623-f4ef-4a2c-a0ed-6588e3694c49 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:45.630617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:45.631582 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:45.632002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:45.632420 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:45.633328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:45.633785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:45.635314 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.640542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 356/700] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:45.641673 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.697542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1bdf7-d234-4c98-b6f3-1cdd6a0a1ca9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:45.751788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5ee0e-46e6-42a8-92f6-d827c56be8d6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:45.761435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:45.762845 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:45.763091 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:45.763635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:45.765105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=0734d46e1f4c4994a03d56f0591dfded) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:45.765693 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:45.768039 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.780482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 345/701] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/role_assignments?user.id=0734d46e1f4c4994a03d56f0591dfded&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:45.782336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.791134 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:45.792112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:45.792543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:45.792983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:45.794056 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:45.794574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:45.796184 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:45.820223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 357/702] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:45.834303 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:45.993376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239da374-899f-4bb5-a72b-c0a8c21d89e1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:46.063396 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3638-d55e-498c-bf1b-eaff1150b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:46.064798 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3638-d55e-498c-bf1b-eaff1150b3cf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:46.065404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3638-d55e-498c-bf1b-eaff1150b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:46.066001 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3638-d55e-498c-bf1b-eaff1150b3cf None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:46.067539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e3638-d55e-498c-bf1b-eaff1150b3cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:46.068234 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e3638-d55e-498c-bf1b-eaff1150b3cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:46.076704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e3638-d55e-498c-bf1b-eaff1150b3cf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:46.089075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 346/703] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:46.231783 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6628c-8ec2-4218-954c-b7811e81f339 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:46.252346 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf404f-8bbc-46fb-8be2-e014c73fedce None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:46.252638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf404f-8bbc-46fb-8be2-e014c73fedce None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:46.252954 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf404f-8bbc-46fb-8be2-e014c73fedce None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:46.254686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 347/704] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:46.271963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31db9-e584-4414-8e95-5057407117ee None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:46.272461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31db9-e584-4414-8e95-5057407117ee None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:46.272977 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31db9-e584-4414-8e95-5057407117ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:46.288224 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee22f6-856c-4537-adcb-ef6b3a255c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:46.288926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee22f6-856c-4537-adcb-ef6b3a255c3c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:46.289209 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee22f6-856c-4537-adcb-ef6b3a255c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:46.289482 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee22f6-856c-4537-adcb-ef6b3a255c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:46.313680 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f8a31db9-e584-4414-8e95-5057407117ee None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:46.315796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f8a31db9-e584-4414-8e95-5057407117ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:46.372646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee22f6-856c-4537-adcb-ef6b3a255c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:46.375526 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee22f6-856c-4537-adcb-ef6b3a255c3c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:46.452918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 348/705] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:46.494285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a31db9-e584-4414-8e95-5057407117ee None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:46.552952 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 358/706] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 13:59:46.557763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee22f6-856c-4537-adcb-ef6b3a255c3c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:46.614987 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a31db9-e584-4414-8e95-5057407117ee None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:46.671465 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:46.672535 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:46.672845 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:46.673119 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] PATH_INFO: `/v3/services/network` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:46.673783 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:46.675154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:46.701638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:46.703582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 13:59:46.705241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:46.708709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 349/707] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:46 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:46.717207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:46.785151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee22f6-856c-4537-adcb-ef6b3a255c3c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:46.844480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:46.846407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:46.847280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:46.856713 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:46.873970 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:46.875458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:46.900837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:46.902586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:46.904400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:46.904400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:46.904400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:46.904400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:46.904400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 359/708] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:46.910445 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:46.983237 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca3ec-9ae5-45c9-8e80-14bdaa9b4250 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:47.083280 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:47.088228 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:47.089134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:47.089899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:47.091595 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] RBAC: Adding query filter params (name=network) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:47.099646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:47.103194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:47.118317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 350/709] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 13:59:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:47.129366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:47.165335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d20d-4dbd-4f15-a793-3ba7b7b3ce9f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:47.270621 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:47.273552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:47.274255 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:47.274916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:47.277422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:47.278378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:47.281345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:47.325575 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 360/710] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:47.335703 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:47.438168 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5f5b2-e644-43a6-8a76-20948d43499a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:47.504376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a507-89fc-4eef-9ebf-a979ac181b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:47.508415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a507-89fc-4eef-9ebf-a979ac181b30 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:47.510467 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a507-89fc-4eef-9ebf-a979ac181b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:47.511237 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a507-89fc-4eef-9ebf-a979ac181b30 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:47.513997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960a507-89fc-4eef-9ebf-a979ac181b30 None admin] RBAC: Adding query filter params (type=network) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:47.515838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960a507-89fc-4eef-9ebf-a979ac181b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:47.519086 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960a507-89fc-4eef-9ebf-a979ac181b30 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:47.541829 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 351/711] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 13:59:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:47.605158 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4967f-3f42-45b2-89a1-d399a4e3e03e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:47.605647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4967f-3f42-45b2-89a1-d399a4e3e03e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:47.606119 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4967f-3f42-45b2-89a1-d399a4e3e03e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:47.613204 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 352/712] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:59:47.616320 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463b3b-6f38-4b0c-ad9a-548b30ec1f09 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:47.616849 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463b3b-6f38-4b0c-ad9a-548b30ec1f09 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:47.617334 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463b3b-6f38-4b0c-ad9a-548b30ec1f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:47.627260 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294166a4-28ec-41a1-9137-d611b8443a37 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:47.674491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3d463b3b-6f38-4b0c-ad9a-548b30ec1f09 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:47.676749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3d463b3b-6f38-4b0c-ad9a-548b30ec1f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:47.700906 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:47.702790 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:47.703587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:47.704367 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:47.719942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:47.723555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:47.752414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:47.754251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:47.756560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:47.756560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:47.756560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:47.756560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:47.756560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:47.756560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:47.756560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:47.756560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:47.761326 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 361/713] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:47.778980 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:47.869978 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 353/714] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:47.913387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d463b3b-6f38-4b0c-ad9a-548b30ec1f09 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:48.048844 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431a00-0a5c-429e-a64d-3e88095f8de6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:48.110207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:48.111230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:48.111645 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:48.112053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:48.113435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:48.113906 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:48.116972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:48.139756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 362/715] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:48.142657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d463b3b-6f38-4b0c-ad9a-548b30ec1f09 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:48.150043 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:48.205148 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:48.206565 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:48.207019 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:48.207514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:48.228942 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:48.231732 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:48.265958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:48.266946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:48.267823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:48.267823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:48.267823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:48.267823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:48.272703 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 354/716] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:48.278480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:48.399787 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982187b5-145e-4808-93f8-85c154c78fe9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:48.472463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:48.473169 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:48.473452 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:48.473722 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:48.474622 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=c40d0702d56d47b48afc200b4de3027f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:48.475179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:48.476706 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:48.493829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 363/717] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:48 2022] GET /identity/v3/role_assignments?user.id=c40d0702d56d47b48afc200b4de3027f&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=52bf3a299728408b8384e30e08547fd8 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:48.501290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409aa5f-0da5-4241-bbc2-33bfd5b456c0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:48.548731 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fb990-252c-44ae-8d7b-bcdaf73ed7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:48.549521 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb990-252c-44ae-8d7b-bcdaf73ed7bc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:48.549719 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb990-252c-44ae-8d7b-bcdaf73ed7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:48.549989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb990-252c-44ae-8d7b-bcdaf73ed7bc None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:48.550759 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fb990-252c-44ae-8d7b-bcdaf73ed7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:48.551066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fb990-252c-44ae-8d7b-bcdaf73ed7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:48.552559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fb990-252c-44ae-8d7b-bcdaf73ed7bc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:48.568246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 355/718] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:48.582430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:48.795550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2656fd-d0d4-4055-8b89-7c4a2f5ee9a8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:48.888930 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d533b5d-6886-4782-b1d1-8896ef052dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:48.889636 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d533b5d-6886-4782-b1d1-8896ef052dfa None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:48.889921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d533b5d-6886-4782-b1d1-8896ef052dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:48.890204 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d533b5d-6886-4782-b1d1-8896ef052dfa None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:48.890966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d533b5d-6886-4782-b1d1-8896ef052dfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:48.892486 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d533b5d-6886-4782-b1d1-8896ef052dfa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:48.941699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 364/719] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 13:59:48 2022] POST /identity/v3/users => generated 254 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 13:59:49.228860 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a9bf-6124-4f60-8398-f0da41779094 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:49.229068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a9bf-6124-4f60-8398-f0da41779094 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:49.229363 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a9bf-6124-4f60-8398-f0da41779094 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:49.230883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 356/720] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:49.252632 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554ab8-768c-487a-8d72-7ce37bb2c4b8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:49.253025 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554ab8-768c-487a-8d72-7ce37bb2c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:49.253230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554ab8-768c-487a-8d72-7ce37bb2c4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:49.272293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-25554ab8-768c-487a-8d72-7ce37bb2c4b8 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:49.273574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-25554ab8-768c-487a-8d72-7ce37bb2c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:49.401840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 365/721] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:49.440780 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63a9bf-6124-4f60-8398-f0da41779094 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:49.592719 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63a9bf-6124-4f60-8398-f0da41779094 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:49.643420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6a474-d283-47a4-badc-f25b943eda7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:49.644120 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6a474-d283-47a4-badc-f25b943eda7a None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:49.644399 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6a474-d283-47a4-badc-f25b943eda7a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:49.644691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6a474-d283-47a4-badc-f25b943eda7a None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:49.645462 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6a474-d283-47a4-badc-f25b943eda7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:49.646972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6a474-d283-47a4-badc-f25b943eda7a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:49.676498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 357/722] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 13:59:49 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:59:49.989319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9d6e-ace4-4f65-83d9-d2c636beed59 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:49.990049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9d6e-ace4-4f65-83d9-d2c636beed59 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:49.990583 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9d6e-ace4-4f65-83d9-d2c636beed59 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:49.992494 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 366/723] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:49.998785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505f040-b74a-4caa-9652-63651e99b615 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:49.999389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505f040-b74a-4caa-9652-63651e99b615 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:49.999882 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505f040-b74a-4caa-9652-63651e99b615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:50.018381 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c505f040-b74a-4caa-9652-63651e99b615 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:50.020064 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c505f040-b74a-4caa-9652-63651e99b615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:50.112652 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 358/724] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 13:59:50.138589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f9d6e-ace4-4f65-83d9-d2c636beed59 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:50.265122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f9d6e-ace4-4f65-83d9-d2c636beed59 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:50.312338 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484de1ec-95fe-4dd5-a74d-0de9d07433d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:50.313186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de1ec-95fe-4dd5-a74d-0de9d07433d7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:50.313466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de1ec-95fe-4dd5-a74d-0de9d07433d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:50.313736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de1ec-95fe-4dd5-a74d-0de9d07433d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:50.326243 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484de1ec-95fe-4dd5-a74d-0de9d07433d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-484de1ec-95fe-4dd5-a74d-0de9d07433d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:50.334834 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:50.335852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:50.336737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 367/725] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:50.350670 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505f040-b74a-4caa-9652-63651e99b615 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:50.471062 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505f040-b74a-4caa-9652-63651e99b615 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:50.516091 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:50.516723 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:50.517012 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:50.517288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:50.518059 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:50.518367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:50.519752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:50.532958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 359/726] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:50.539536 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484de1ec-95fe-4dd5-a74d-0de9d07433d7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:50.700250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484de1ec-95fe-4dd5-a74d-0de9d07433d7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:50.740521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b360e-c61e-4023-bd6b-76c89b5e4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:50.741365 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b360e-c61e-4023-bd6b-76c89b5e4978 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:50.741645 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b360e-c61e-4023-bd6b-76c89b5e4978 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:50.741920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b360e-c61e-4023-bd6b-76c89b5e4978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:50.753741 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b360e-c61e-4023-bd6b-76c89b5e4978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:50.755311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b360e-c61e-4023-bd6b-76c89b5e4978 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-147b360e-c61e-4023-bd6b-76c89b5e4978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:50.775425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:50.776380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:50.777307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:50.777307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:50.777307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:50.777307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:50.777307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 368/727] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:50.785859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:50.966722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60679eee-1f2a-42f2-afde-10ec72da7f1c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:50.972216 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83bad3-41cd-49e5-b3be-e9f607692410 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:50.972883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83bad3-41cd-49e5-b3be-e9f607692410 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:50.973388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83bad3-41cd-49e5-b3be-e9f607692410 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:50.980709 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 369/728] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:50.986664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa5fa-3681-416d-b7df-3a521ea83f3e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:50.986940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa5fa-3681-416d-b7df-3a521ea83f3e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:50.987215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa5fa-3681-416d-b7df-3a521ea83f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:51.025895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-39baa5fa-3681-416d-b7df-3a521ea83f3e None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:51.027026 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-39baa5fa-3681-416d-b7df-3a521ea83f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:51.028471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:51.029640 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:51.030126 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:51.030611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:51.031976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:51.032513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:51.035083 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:51.057371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 360/729] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:51.070342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:51.108038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 370/730] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 13:59:51.139012 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baa5fa-3681-416d-b7df-3a521ea83f3e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:51.258772 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baa5fa-3681-416d-b7df-3a521ea83f3e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:51.308222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318262-5351-4490-90d7-660af840d438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:51.309284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318262-5351-4490-90d7-660af840d438 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:51.309782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318262-5351-4490-90d7-660af840d438 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:51.310280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318262-5351-4490-90d7-660af840d438 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:51.311534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef318262-5351-4490-90d7-660af840d438 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:51.314062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef318262-5351-4490-90d7-660af840d438 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:51.347155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31130c26-3fec-4272-a55c-929a8c3bfd39 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:51.358049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 371/731] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 13:59:51 2022] POST /identity/v3/services => generated 240 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 13:59:51.446806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:51.448296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:51.448829 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:51.449309 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:51.465333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:51.468299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:51.499350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:51.502976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:51.506506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 361/732] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:51.518489 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318262-5351-4490-90d7-660af840d438 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:51.711801 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318262-5351-4490-90d7-660af840d438 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:51.774934 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9acc1-9463-47b5-8d9a-9c0097491086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:51.776032 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9acc1-9463-47b5-8d9a-9c0097491086 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:51.776540 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9acc1-9463-47b5-8d9a-9c0097491086 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:51.777056 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9acc1-9463-47b5-8d9a-9c0097491086 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:51.778166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9acc1-9463-47b5-8d9a-9c0097491086 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:51.778706 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9acc1-9463-47b5-8d9a-9c0097491086 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:51.780372 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9acc1-9463-47b5-8d9a-9c0097491086 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:51.806993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 372/733] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 13:59:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:51.813284 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:52.017002 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96681-595f-47f7-8bac-f7d95552adba None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:52.064400 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821479-fa0d-4fd2-85f7-66d345eaa8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:52.065463 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821479-fa0d-4fd2-85f7-66d345eaa8da None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:52.065976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821479-fa0d-4fd2-85f7-66d345eaa8da None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:52.066457 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821479-fa0d-4fd2-85f7-66d345eaa8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:52.162968 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821479-fa0d-4fd2-85f7-66d345eaa8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:52.164998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821479-fa0d-4fd2-85f7-66d345eaa8da None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:52.196116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79cc35-75ad-4734-aae3-edd58137ef91 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:52.196460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79cc35-75ad-4734-aae3-edd58137ef91 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:52.196663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79cc35-75ad-4734-aae3-edd58137ef91 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:52.198420 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 373/734] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:52.215146 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648f093-8c35-4f9d-ae6d-a2399fe24b71 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:52.215479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648f093-8c35-4f9d-ae6d-a2399fe24b71 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:52.215691 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648f093-8c35-4f9d-ae6d-a2399fe24b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:52.253864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2648f093-8c35-4f9d-ae6d-a2399fe24b71 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:52.253864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2648f093-8c35-4f9d-ae6d-a2399fe24b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:52.338305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 362/735] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 13:59:52.344261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821479-fa0d-4fd2-85f7-66d345eaa8da None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:52.361146 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 374/736] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 13:59:52.410335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648f093-8c35-4f9d-ae6d-a2399fe24b71 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:52.521947 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648f093-8c35-4f9d-ae6d-a2399fe24b71 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:52.559358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094c0d8-1491-46be-94fd-80625d0fe40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:52.560168 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094c0d8-1491-46be-94fd-80625d0fe40a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:52.560446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094c0d8-1491-46be-94fd-80625d0fe40a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:52.560736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094c0d8-1491-46be-94fd-80625d0fe40a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:52.563027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821479-fa0d-4fd2-85f7-66d345eaa8da None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:52.574301 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094c0d8-1491-46be-94fd-80625d0fe40a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d094c0d8-1491-46be-94fd-80625d0fe40a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:52.582041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:52.583048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:52.584534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 375/737] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:52.595312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094c0d8-1491-46be-94fd-80625d0fe40a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:52.647916 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:52.649172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:52.649664 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:52.650140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:52.684521 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:52.687346 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:52.713005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094c0d8-1491-46be-94fd-80625d0fe40a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:52.734503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:52.735515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:52.736542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:52.736542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:52.736542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:52.736542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:52.736542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 363/738] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:52.743160 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:52.794891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:52.795584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:52.795863 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:52.796135 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:52.796927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:52.798045 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:52.805426 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:52.828584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 376/739] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:52.840825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:52.893225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522e46a-811a-40d1-b029-b702cb1b57cc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:52.945798 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:52.947052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:52.947575 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:52.948713 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:52.949815 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:52.950345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:52.952042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:52.969142 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 364/740] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:52.976538 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:53.129403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a634c6-f93d-4648-8bf1-d6145892033d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:53.161001 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6e5cc-5f8f-499e-8d01-dd7f025c3877 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:53.204097 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:53.204992 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.205276 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.205545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.224654 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:53.226416 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:53.232973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:53.233850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.234135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.234409 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.248843 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:53.250316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:53.266732 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:53.267723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:53.268624 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:53.268624 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:53.268624 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:53.268624 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:53.268624 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 377/741] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:53.279560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:53.279771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:53.280611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:53.281545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 365/742] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:53.290281 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:53.454879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d50cb-7d1d-44eb-ab9d-a4240dba66ab None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:53.500050 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31e40-a29f-4159-a840-cc09cf1deea6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:53.532628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab59b37-12e7-4821-a1f4-8b410c8a5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:53.533755 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59b37-12e7-4821-a1f4-8b410c8a5068 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.534475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59b37-12e7-4821-a1f4-8b410c8a5068 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.534937 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59b37-12e7-4821-a1f4-8b410c8a5068 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.537285 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab59b37-12e7-4821-a1f4-8b410c8a5068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:53.537788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab59b37-12e7-4821-a1f4-8b410c8a5068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:53.540269 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab59b37-12e7-4821-a1f4-8b410c8a5068 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:53.566204 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b3578-1d6d-4f9c-bfb3-ad5fe05f2b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:53.566805 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 378/743] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:53.567299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3578-1d6d-4f9c-bfb3-ad5fe05f2b8e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.567799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3578-1d6d-4f9c-bfb3-ad5fe05f2b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.568793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3578-1d6d-4f9c-bfb3-ad5fe05f2b8e None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.569766 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa85c-f8c8-4c42-a51d-c2d070555f0e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.570184 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b3578-1d6d-4f9c-bfb3-ad5fe05f2b8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:53.570307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa85c-f8c8-4c42-a51d-c2d070555f0e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.570624 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afa85c-f8c8-4c42-a51d-c2d070555f0e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.570737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b3578-1d6d-4f9c-bfb3-ad5fe05f2b8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:53.573408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 379/744] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:53.573551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b3578-1d6d-4f9c-bfb3-ad5fe05f2b8e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:53.574750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afa85c-f8c8-4c42-a51d-c2d070555f0e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:53.610736 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 366/745] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:53.613091 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb0fb-45a5-47ce-b6a9-c457f767f5a7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.613579 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb0fb-45a5-47ce-b6a9-c457f767f5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.614060 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb0fb-45a5-47ce-b6a9-c457f767f5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.645695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-22abb0fb-45a5-47ce-b6a9-c457f767f5a7 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:53.648611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-22abb0fb-45a5-47ce-b6a9-c457f767f5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:53.752407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afa85c-f8c8-4c42-a51d-c2d070555f0e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:53.762379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 367/746] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 13:59:53.766419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abb0fb-45a5-47ce-b6a9-c457f767f5a7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:53.811077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c28ec2-6de6-4a55-a199-d4dc0950bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:53.811892 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c28ec2-6de6-4a55-a199-d4dc0950bd7d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.812173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c28ec2-6de6-4a55-a199-d4dc0950bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.812448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c28ec2-6de6-4a55-a199-d4dc0950bd7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.821045 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c28ec2-6de6-4a55-a199-d4dc0950bd7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:53.822544 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c28ec2-6de6-4a55-a199-d4dc0950bd7d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-26c28ec2-6de6-4a55-a199-d4dc0950bd7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:53.839252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:53.841257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 13:59:53.843115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:53.845233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 380/747] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 13:59:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:53.846935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aa7fe-3637-4803-b911-bb4ca1b1668a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.847194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aa7fe-3637-4803-b911-bb4ca1b1668a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.847463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aa7fe-3637-4803-b911-bb4ca1b1668a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.848814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 381/748] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:53.849923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104aa7fe-3637-4803-b911-bb4ca1b1668a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:53.899438 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abb0fb-45a5-47ce-b6a9-c457f767f5a7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:53.950626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:53.951310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:53.951590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:53.951868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:53.952748 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=0734d46e1f4c4994a03d56f0591dfded) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:53.953066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:53.954513 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:53.969262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 368/749] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:53 2022] GET /identity/v3/role_assignments?user.id=0734d46e1f4c4994a03d56f0591dfded&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=52bf3a299728408b8384e30e08547fd8 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:53.971286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:53.998173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104aa7fe-3637-4803-b911-bb4ca1b1668a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:54.061413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa62f4d-2712-438d-9516-61dd8799e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:54.063269 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa62f4d-2712-438d-9516-61dd8799e029 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.064070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa62f4d-2712-438d-9516-61dd8799e029 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.064827 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa62f4d-2712-438d-9516-61dd8799e029 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.085221 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa62f4d-2712-438d-9516-61dd8799e029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9fa62f4d-2712-438d-9516-61dd8799e029 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:54.100181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:54.102484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 13:59:54.104123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:54.109091 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 382/750] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 13:59:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:54.111753 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145336-e96d-4d56-b792-0ba312935fd9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.112536 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145336-e96d-4d56-b792-0ba312935fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.113320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145336-e96d-4d56-b792-0ba312935fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.141605 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-84145336-e96d-4d56-b792-0ba312935fd9 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:54.144220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-84145336-e96d-4d56-b792-0ba312935fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:54.196164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48d358-a966-4530-a66d-d42e2f02fee7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:54.253006 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 383/751] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 13:59:54.254419 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145336-e96d-4d56-b792-0ba312935fd9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:54.274032 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051e82d-c919-4510-a163-edb857656234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:54.275198 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051e82d-c919-4510-a163-edb857656234 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.276435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051e82d-c919-4510-a163-edb857656234 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.276991 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051e82d-c919-4510-a163-edb857656234 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.279185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051e82d-c919-4510-a163-edb857656234 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:54.279741 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051e82d-c919-4510-a163-edb857656234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:54.282898 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051e82d-c919-4510-a163-edb857656234 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:54.330396 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 369/752] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 13:59:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:54.332555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051e82d-c919-4510-a163-edb857656234 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:54.391584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145336-e96d-4d56-b792-0ba312935fd9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:54.430587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:54.431280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.431565 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.431843 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.432631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:54.432977 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:54.434967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:54.453887 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 384/753] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 13:59:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:54.453887 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:54.508781 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051e82d-c919-4510-a163-edb857656234 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:54.544761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a376da-ebf4-45f4-8bb7-490eedf7b3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:54.545591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a376da-ebf4-45f4-8bb7-490eedf7b3cc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.546094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a376da-ebf4-45f4-8bb7-490eedf7b3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.546428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a376da-ebf4-45f4-8bb7-490eedf7b3cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.547026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a376da-ebf4-45f4-8bb7-490eedf7b3cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:54.548435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a376da-ebf4-45f4-8bb7-490eedf7b3cc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f1a376da-ebf4-45f4-8bb7-490eedf7b3cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:54.564189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:54.566241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 13:59:54.567938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:54.572920 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 370/754] 10.222.0.13 () {56 vars in 1129 bytes} [Mon May 16 13:59:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:54.575093 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5319751-e817-4105-8ad5-11486ac64ff5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.575515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5319751-e817-4105-8ad5-11486ac64ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.575987 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5319751-e817-4105-8ad5-11486ac64ff5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.578424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 371/755] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:54.582906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5319751-e817-4105-8ad5-11486ac64ff5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:54.615867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f29a0-6a4c-447b-b6d2-63aae3124f3e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:54.657629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:54.658441 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.658736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.658996 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.671637 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:54.673154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:54.691564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:54.692543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:54.694381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:54.694381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:54.694381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:54.694381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:54.697098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 385/756] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:54.698499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:54.723562 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5319751-e817-4105-8ad5-11486ac64ff5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:54.767758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5b1b2-73ca-4a18-b397-4061df76dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:54.768907 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5b1b2-73ca-4a18-b397-4061df76dca5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.769324 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5b1b2-73ca-4a18-b397-4061df76dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.769787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5b1b2-73ca-4a18-b397-4061df76dca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.782691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5b1b2-73ca-4a18-b397-4061df76dca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:54.784178 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5b1b2-73ca-4a18-b397-4061df76dca5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c3d5b1b2-73ca-4a18-b397-4061df76dca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:54.812200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:54.813212 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:54.814146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:54.814146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:54.814146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:54.814146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:54.814146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 372/757] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:54.815939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a42a94-31f4-44f6-a4f1-a7d724bc38dc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.816417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a42a94-31f4-44f6-a4f1-a7d724bc38dc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.816979 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a42a94-31f4-44f6-a4f1-a7d724bc38dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.833381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c7357-ac53-4f9b-aa35-b07274bac88c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:54.838362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e8a42a94-31f4-44f6-a4f1-a7d724bc38dc None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:54.839580 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e8a42a94-31f4-44f6-a4f1-a7d724bc38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:54.881110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:54.882272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:54.882762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:54.883249 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:54.884621 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:54.885079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:54.887467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:54.899033 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 386/758] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 13:59:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:54.899033 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:54.927761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 373/759] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 13:59:54.929280 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a42a94-31f4-44f6-a4f1-a7d724bc38dc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.060350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dffe5a-9582-45b4-95af-903949a63fb3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.068633 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a42a94-31f4-44f6-a4f1-a7d724bc38dc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.107752 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.108877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.109159 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.109436 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.110182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:55.110482 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.111885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.121668 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.122953 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.123451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.123944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.125426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:55.125971 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.131542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 387/760] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:55.131542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.131865 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.151850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 374/761] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:55.153139 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.259949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8358d-2258-4cc4-8154-c77cbcdb4ba5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.299626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca05440-eccb-48e7-88c8-016af27854a9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.311816 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.312865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.313275 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.313737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.314663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:55.315107 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.317031 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.332706 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 388/762] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:55.332706 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.348807 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.349631 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.349956 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.350251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] PATH_INFO: `/v3/services/network` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.351254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.352648 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:55.365564 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:55.367355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:55.369088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 375/763] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:55.370646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.477011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c38a-1ead-49f4-b0c1-cc50d234c902 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.504493 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dda48e-c053-4f24-b6bb-aba1ef74d681 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.518911 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.519719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.520003 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.520249 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.528900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.530374 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:55.545684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:55.546665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:55.547543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 389/764] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:55.548488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.557512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.558355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.558632 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.558906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.567581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.569388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:55.585859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:55.587724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 376/765] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:55.590573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.671418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864b27-076f-4923-bdd2-06d6a6dc0741 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.711546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.712387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4cec-1e52-4b41-95ab-b8a94be78570 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.712557 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.712942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.713344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.714401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] RBAC: Adding query filter params (interface=public, service_id=ebf05a32314a4bee973cd7130489deb3, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:55.714916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.716850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.727238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 390/766] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/endpoints?service_id=ebf05a32314a4bee973cd7130489deb3&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:55.728700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.772905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.773826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.774246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.774656 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.775727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] RBAC: Adding query filter params (name=network) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:55.776188 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.777906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.783934 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 377/767] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:55.785316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:55.900396 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10bc9e-2791-4762-b084-fc6444172b81 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.927959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3580cb-21b0-49e4-acf6-5c8443c0cbdf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:55.953445 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.954501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.954814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.955040 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.955854 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:55.956150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.957660 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.968823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:55.969519 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:55.969802 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:55.970082 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:55.970943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:55.971249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:55.972734 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:55.982159 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 391/768] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:55.982159 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:56.016818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 378/769] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:56.016818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:56.090799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd4825-ea2d-4a75-af46-8aaf79846595 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:56.133302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdcb10-a343-4b16-8aa9-02fb0fde60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:56.133983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdcb10-a343-4b16-8aa9-02fb0fde60c4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:56.134257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdcb10-a343-4b16-8aa9-02fb0fde60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:56.134523 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdcb10-a343-4b16-8aa9-02fb0fde60c4 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:56.135223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdcb10-a343-4b16-8aa9-02fb0fde60c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:56.136620 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdcb10-a343-4b16-8aa9-02fb0fde60c4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:56.150682 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee4713-0f29-4a80-b860-80f0d2367283 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:56.152976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 392/770] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 13:59:55 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:56.152976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdcb10-a343-4b16-8aa9-02fb0fde60c4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:56.196808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:56.197954 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:56.198507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:56.199019 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:56.200006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:56.200551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:56.202283 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:56.217216 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 379/771] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 13:59:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:56.218647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:56.346047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdcb10-a343-4b16-8aa9-02fb0fde60c4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:56.388978 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c9d5-8141-4c48-b26f-07ed580e0773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:56.389983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c9d5-8141-4c48-b26f-07ed580e0773 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:56.390271 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c9d5-8141-4c48-b26f-07ed580e0773 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:56.390515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c9d5-8141-4c48-b26f-07ed580e0773 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/c40d0702d56d47b48afc200b4de3027f/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:56.392570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686c9d5-8141-4c48-b26f-07ed580e0773 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=c40d0702d56d47b48afc200b4de3027f, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:56.394100 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686c9d5-8141-4c48-b26f-07ed580e0773 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:56.416855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 393/772] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 13:59:56 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/c40d0702d56d47b48afc200b4de3027f/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 13:59:56.416855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c9d5-8141-4c48-b26f-07ed580e0773 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:56.431251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aa1ef-3e4e-4130-8bf0-60d9707fefd7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:56.528355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6505c38-04ae-4c33-a269-70a33db71a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:56.530092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505c38-04ae-4c33-a269-70a33db71a35 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:56.530092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505c38-04ae-4c33-a269-70a33db71a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:56.530524 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6505c38-04ae-4c33-a269-70a33db71a35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:56.580887 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c9d5-8141-4c48-b26f-07ed580e0773 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:56.636266 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:56.637228 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:56.637696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:56.638149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:56.639157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] RBAC: Adding query filter params (interface=public, service_id=dc4d343eaff64977bf27a665280f7ce9, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:56.639615 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:56.641197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:56.648206 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 394/773] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 13:59:56 2022] GET /identity/v3/endpoints?service_id=dc4d343eaff64977bf27a665280f7ce9&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:56.656177 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:56.673844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6505c38-04ae-4c33-a269-70a33db71a35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:56.676596 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6505c38-04ae-4c33-a269-70a33db71a35 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:56.771317 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3f5d-67ca-4493-9341-3f1e1d674cc9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:56.814951 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c821f-bf27-4316-96a9-056fb201438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:56.815942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c821f-bf27-4316-96a9-056fb201438b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:56.816433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c821f-bf27-4316-96a9-056fb201438b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:56.816981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c821f-bf27-4316-96a9-056fb201438b None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:56.818532 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c821f-bf27-4316-96a9-056fb201438b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:56.821708 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c821f-bf27-4316-96a9-056fb201438b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:56.831448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 395/774] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 13:59:56 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:56.835833 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7e922-1067-4958-8def-5e046014b62b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:56.836304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7e922-1067-4958-8def-5e046014b62b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:56.837437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7e922-1067-4958-8def-5e046014b62b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:56.839748 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 396/775] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 13:59:56.850380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe1397-ba1c-4456-9017-fa6256d24c39 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:56.851091 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe1397-ba1c-4456-9017-fa6256d24c39 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:56.851935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe1397-ba1c-4456-9017-fa6256d24c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:56.864565 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 380/776] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 13:59:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 13:59:56.875922 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6505c38-04ae-4c33-a269-70a33db71a35 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:56.882510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-01fe1397-ba1c-4456-9017-fa6256d24c39 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 13:59:56.884526 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-01fe1397-ba1c-4456-9017-fa6256d24c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 13:59:57.001123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 397/777] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 13:59:57.054280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe1397-ba1c-4456-9017-fa6256d24c39 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:57.093496 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6505c38-04ae-4c33-a269-70a33db71a35 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:57.153215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:57.154030 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:57.154307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:57.154581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:57.167516 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:57.169214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:57.192964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:57.195248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:57.197990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:57.197990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:57.197990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:57.197990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:57.197990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 381/778] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:57.206135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:57.278187 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe1397-ba1c-4456-9017-fa6256d24c39 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:57.319974 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dcd58-b6a7-4509-82f0-7a0707045076 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:57.344234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8a42-7e87-47b8-aa3b-3dc225c8e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:57.345695 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8a42-7e87-47b8-aa3b-3dc225c8e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:57.346283 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8a42-7e87-47b8-aa3b-3dc225c8e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:57.346839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8a42-7e87-47b8-aa3b-3dc225c8e9d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:57.359699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:57.360643 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:57.361114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:57.361526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:57.362654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:57.363109 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:57.365099 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:57.369963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f8a42-7e87-47b8-aa3b-3dc225c8e9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 13:59:57.378924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 382/779] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-497f8a42-7e87-47b8-aa3b-3dc225c8e9d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 13:59:57.385647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:57.386894 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 13:59:57.387871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:57.389850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:57.391466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 398/780] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:57.404723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8a42-7e87-47b8-aa3b-3dc225c8e9d6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:57.646496 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8a42-7e87-47b8-aa3b-3dc225c8e9d6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:57.650721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a209bd-49e8-4e8b-ad2f-30319c6c9ff1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:57.715211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:57.717707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:57.718191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:57.718650 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:57.720135 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:57.720699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:57.723320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:57.746745 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:57.748157 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:57.748653 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:57.749183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:57.759058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 399/781] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 13:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:57.770627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:57.777041 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:57.779787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:57.813998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:57.814965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:57.815854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:57.815854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:57.815854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:57.815854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:57.815854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:57.815854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:57.815854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:57.815854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 13:59:57.818659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 383/782] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:57.826957 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:57.909878 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6563-18a0-4f7b-b9c9-10b52b6ecd9d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:57.967546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:57.968940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:57.969427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:57.969910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:57.996244 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:57.997788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:58.029921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:58.032294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:58.034098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:58.034098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:58.034098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:58.034098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:58.035423 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 400/783] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:58.041007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:58.109526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083344f9-a9a7-4fe4-bae7-39a8f1eeff37 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:58.219298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:58.220215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:58.220505 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:58.220828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:58.221642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:58.222163 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:58.223414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:58.244563 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 384/784] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:58.249045 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:58.275284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4ede-e577-47b8-ba04-4f072c6db977 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:58.389903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:58.391510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:58.392282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:58.393085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:58.394785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:58.395625 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:58.399034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:58.440323 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 401/785] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 13:59:58.454412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:58.456144 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2240e59-aaf6-45ad-8b00-28ab8aaa48af None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:58.512867 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:58.512867 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:58.512867 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:58.512867 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:58.513271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=7616958327124128a02166a27c462312) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:58.513271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:58.513271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:58.527108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 385/786] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 13:59:58 2022] GET /identity/v3/role_assignments?user.id=7616958327124128a02166a27c462312&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:58.681327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12a8f8-6683-4b29-854d-91bd0be24909 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:58.731558 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:58.732839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:58.733343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:58.733824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:58.748972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:58.750949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 13:59:58.772776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:58.773767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 13:59:58.774808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:58.777700 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 402/787] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 13:59:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:58.783247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:58.960561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d9e41-a4b6-4987-ba48-dcbb8db6f529 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:59.030305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:59.031395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:59.031859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:59.032312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:59.033819 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:59.034362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:59.038169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:59.059007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 386/788] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 13:59:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:59.064230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:59.216022 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15a473-b6dc-48ca-ad24-52db22d39975 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:59.252524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:59.253407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:59.253692 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:59.253963 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:59.265458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:59.266937 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 13:59:59.286964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:59.288075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:59.289042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 13:59:59.289042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 13:59:59.289042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 13:59:59.289042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:59.289042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 403/789] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 13:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 13:59:59.294188 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:59.401241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d52005-4bf5-4fee-97fa-1b295f23efd7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:59.461504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:59.462542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:59.463005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:59.463469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:59.464387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:59.464910 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:59.467818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:59.481298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 387/790] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 13:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 13:59:59.487903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:59.688181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7110eec-7f06-422e-9ae7-35482af8fb1a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:59.732099 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf458703-3cc8-4540-a6e1-676f291e0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:59.733289 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf458703-3cc8-4540-a6e1-676f291e0f78 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:59.733756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf458703-3cc8-4540-a6e1-676f291e0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:59.734208 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf458703-3cc8-4540-a6e1-676f291e0f78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:59.742310 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf458703-3cc8-4540-a6e1-676f291e0f78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:59.744171 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf458703-3cc8-4540-a6e1-676f291e0f78 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cf458703-3cc8-4540-a6e1-676f291e0f78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 13:59:59.763965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 13:59:59.769235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 13:59:59.770158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 13:59:59.770158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 13:59:59.770158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 13:59:59.770158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 13:59:59.770158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 13:59:59.770158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 13:59:59.770158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 13:59:59.770158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 13:59:59.773143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 404/791] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 13:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 13:59:59.779151 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 13:59:59.920464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096362b4-d8b9-4b94-8300-1584a97d7658 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 13:59:59.954216 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f6f5-3935-468c-8a95-a7328307cb63 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:59.954490 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f6f5-3935-468c-8a95-a7328307cb63 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:59.954798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f6f5-3935-468c-8a95-a7328307cb63 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:59.956275 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 405/792] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 13:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 13:59:59.965868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b478b-9088-4f68-ab16-4224709f8a94 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:59.966768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b478b-9088-4f68-ab16-4224709f8a94 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:59.967555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b478b-9088-4f68-ab16-4224709f8a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:59.991054 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 13:59:59.991749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 13:59:59.992039 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 13:59:59.992315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 13:59:59.993176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 13:59:59.993691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 13:59:59.995266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 13:59:59.999537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bd5b478b-9088-4f68-ab16-4224709f8a94 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:00.002077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bd5b478b-9088-4f68-ab16-4224709f8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:00.027982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 388/793] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 13:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:00.034432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:00.164724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685cf9e-da74-4a2d-a6ac-4097b1ab3b4f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:00.181599 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 406/794] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 13:59:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:00.202814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c086c46-9b80-41d7-b025-82ee2ed8c443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:00.204468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c086c46-9b80-41d7-b025-82ee2ed8c443 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.204924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c086c46-9b80-41d7-b025-82ee2ed8c443 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.205422 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c086c46-9b80-41d7-b025-82ee2ed8c443 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/0734d46e1f4c4994a03d56f0591dfded/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.215149 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c086c46-9b80-41d7-b025-82ee2ed8c443 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=0734d46e1f4c4994a03d56f0591dfded, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:00.217944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c086c46-9b80-41d7-b025-82ee2ed8c443 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:00.226824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b478b-9088-4f68-ab16-4224709f8a94 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:00.264303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 389/795] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:00:00 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/0734d46e1f4c4994a03d56f0591dfded/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:00:00.265730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93706cb4-2b43-47e5-be8c-3fb2d2e1f173 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.266019 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93706cb4-2b43-47e5-be8c-3fb2d2e1f173 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.266298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93706cb4-2b43-47e5-be8c-3fb2d2e1f173 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.268562 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 390/796] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:00.291147 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ae8f-72ed-4c9e-9fa4-0e474c75e543 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.291453 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ae8f-72ed-4c9e-9fa4-0e474c75e543 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.291873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ae8f-72ed-4c9e-9fa4-0e474c75e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.321652 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-aad6ae8f-72ed-4c9e-9fa4-0e474c75e543 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:00.322929 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-aad6ae8f-72ed-4c9e-9fa4-0e474c75e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:00.399048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 391/797] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:00.423554 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6ae8f-72ed-4c9e-9fa4-0e474c75e543 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:00.434832 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b478b-9088-4f68-ab16-4224709f8a94 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:00.508794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:00.510749 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.511762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.512569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.514173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:00.517251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:00.541941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:00.543736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:00:00.545446 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:00.547124 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6ae8f-72ed-4c9e-9fa4-0e474c75e543 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:00.556844 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 407/798] 10.222.0.13 () {56 vars in 1129 bytes} [Mon May 16 14:00:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:00.561462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:00.583418 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7fe07-0719-4c4b-831d-93169cf31b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:00.584943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7fe07-0719-4c4b-831d-93169cf31b9a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.585225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7fe07-0719-4c4b-831d-93169cf31b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.585503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7fe07-0719-4c4b-831d-93169cf31b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.597768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7fe07-0719-4c4b-831d-93169cf31b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5af7fe07-0719-4c4b-831d-93169cf31b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:00.606701 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:00.609053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:00.610909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 392/799] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:00.614531 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7fe07-0719-4c4b-831d-93169cf31b9a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:00.733793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7fe07-0719-4c4b-831d-93169cf31b9a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:00.765364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd93c6-86e9-4004-9935-05170323b965 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:00.771017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87707ae6-99ca-45c7-9ce7-e9a01e8049d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:00.771792 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87707ae6-99ca-45c7-9ce7-e9a01e8049d3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.772191 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87707ae6-99ca-45c7-9ce7-e9a01e8049d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.772569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87707ae6-99ca-45c7-9ce7-e9a01e8049d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.773399 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87707ae6-99ca-45c7-9ce7-e9a01e8049d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:00.773703 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87707ae6-99ca-45c7-9ce7-e9a01e8049d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:00.775117 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87707ae6-99ca-45c7-9ce7-e9a01e8049d3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:00.786539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 393/800] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:00.788247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5cd5a-18d4-4b21-842c-da31a8c0fbd4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.788531 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5cd5a-18d4-4b21-842c-da31a8c0fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.793033 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5cd5a-18d4-4b21-842c-da31a8c0fbd4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.794846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 394/801] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:00.796245 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5cd5a-18d4-4b21-842c-da31a8c0fbd4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:00.837451 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a7160-cd60-4752-a04e-95a79a488966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:00.839070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7160-cd60-4752-a04e-95a79a488966 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.839840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7160-cd60-4752-a04e-95a79a488966 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.840619 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7160-cd60-4752-a04e-95a79a488966 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.842319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7160-cd60-4752-a04e-95a79a488966 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:00.843167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7160-cd60-4752-a04e-95a79a488966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:00.846086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7160-cd60-4752-a04e-95a79a488966 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:00.855953 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 408/802] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 14:00:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:00.858883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039d43-6df1-459a-ab2c-885ad7ae9471 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:00.859772 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039d43-6df1-459a-ab2c-885ad7ae9471 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:00.860540 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039d43-6df1-459a-ab2c-885ad7ae9471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:00.890833 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-aa039d43-6df1-459a-ab2c-885ad7ae9471 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:00.894201 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-aa039d43-6df1-459a-ab2c-885ad7ae9471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:01.009419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5cd5a-18d4-4b21-842c-da31a8c0fbd4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:01.051281 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 409/803] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:01.054007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039d43-6df1-459a-ab2c-885ad7ae9471 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:01.087319 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:01.088815 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:01.089320 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:01.089872 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:01.121745 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:01.124786 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:01.162683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:01.164442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:01.167076 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:01.167076 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:01.167076 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:01.167076 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:01.167076 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 395/804] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:01.167076 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:01.291604 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039d43-6df1-459a-ab2c-885ad7ae9471 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:01.362323 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:01.363455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:01.363939 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:01.364436 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:01.366094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:01.366829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:01.369438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:01.387440 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 410/805] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 14:00:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:01.389144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:01.404925 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d9a67-7f8b-47ce-b633-6f79fc0b1d2a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:01.473115 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:01.475135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:01.476208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:01.477035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] PATH_INFO: `/v3/services/network` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:01.478638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:01.481717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:01.505873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:01.507837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:00:01.509559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:01.514869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 396/806] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:01 2022] GET /identity/v3/services/network => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:01.516717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:01.603418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0ce1-f7d9-479e-a34a-9416f083f59f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:01.673378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:01.674431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:01.674940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:01.675432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:01.676801 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:01.677364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:01.680803 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:01.703794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 411/807] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:01.705454 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:01.716740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9aa1-9854-4bb0-8e49-38fe78fc3c3d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:01.779682 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249d59-bb11-403d-88d2-d92b87fe98f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:01.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249d59-bb11-403d-88d2-d92b87fe98f7 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:01.782334 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249d59-bb11-403d-88d2-d92b87fe98f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:01.783118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249d59-bb11-403d-88d2-d92b87fe98f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:01.784922 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249d59-bb11-403d-88d2-d92b87fe98f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:01.788341 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249d59-bb11-403d-88d2-d92b87fe98f7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:01.830177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 397/808] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:00:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:00:01.832711 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249d59-bb11-403d-88d2-d92b87fe98f7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:01.881627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488da2c5-919d-48d3-bac8-ba2a74d2efb5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:01.952997 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a549a-8cf2-4615-a7fd-d41836d4ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:01.954893 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a549a-8cf2-4615-a7fd-d41836d4ae86 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:01.955656 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a549a-8cf2-4615-a7fd-d41836d4ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:01.956420 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a549a-8cf2-4615-a7fd-d41836d4ae86 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:01.958220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a549a-8cf2-4615-a7fd-d41836d4ae86 None admin] RBAC: Adding query filter params (name=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:01.959635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a549a-8cf2-4615-a7fd-d41836d4ae86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:01.962926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a549a-8cf2-4615-a7fd-d41836d4ae86 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:01.972294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 412/809] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:01.975346 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c24b69-6822-48b9-9393-797a78e03539 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:01.976430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c24b69-6822-48b9-9393-797a78e03539 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:01.977220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c24b69-6822-48b9-9393-797a78e03539 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:01.980639 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 413/810] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:01.982640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c24b69-6822-48b9-9393-797a78e03539 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:01.989302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249d59-bb11-403d-88d2-d92b87fe98f7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:02.034140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2108e-e009-426b-8df7-0479497aaf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:02.034961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2108e-e009-426b-8df7-0479497aaf7f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:02.035240 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2108e-e009-426b-8df7-0479497aaf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:02.035508 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2108e-e009-426b-8df7-0479497aaf7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:02.046023 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2108e-e009-426b-8df7-0479497aaf7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:02.047511 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2108e-e009-426b-8df7-0479497aaf7f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e8e2108e-e009-426b-8df7-0479497aaf7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:02.065690 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:02.068740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 398/811] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 14:00:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d98dd-b7d0-4e95-ad76-80f2cf362e10 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:02.070571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d98dd-b7d0-4e95-ad76-80f2cf362e10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:02.071935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d98dd-b7d0-4e95-ad76-80f2cf362e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:02.091305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4a4d98dd-b7d0-4e95-ad76-80f2cf362e10 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:02.092550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4a4d98dd-b7d0-4e95-ad76-80f2cf362e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:02.179272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c24b69-6822-48b9-9393-797a78e03539 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:02.207756 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 399/812] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:02.209430 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d98dd-b7d0-4e95-ad76-80f2cf362e10 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:02.256527 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:02.258104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:02.258594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:02.259070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:02.260412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] RBAC: Adding query filter params (type=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:02.261002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:02.263578 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:02.273241 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 414/813] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:02.274929 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:02.410581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d98dd-b7d0-4e95-ad76-80f2cf362e10 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:02.472198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd552-83ac-4d7b-b287-e52f7802cc4a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:02.482896 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:02.484328 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:02.485025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:02.485685 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:02.488116 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:02.489042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:02.494062 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:02.528664 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 400/814] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 14:00:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:02.530211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:02.552068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576917d9-5582-429b-be87-3bf5646b727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:02.555078 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576917d9-5582-429b-be87-3bf5646b727e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:02.555855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576917d9-5582-429b-be87-3bf5646b727e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:02.557305 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576917d9-5582-429b-be87-3bf5646b727e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:02.581860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576917d9-5582-429b-be87-3bf5646b727e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-576917d9-5582-429b-be87-3bf5646b727e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:02.598035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:02.599118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:00:02.600573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:02.605398 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 415/815] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 14:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:02.607211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576917d9-5582-429b-be87-3bf5646b727e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:02.669867 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03d97-0173-46c2-a90d-c3f5e57669e9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:02.717531 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd610ac-1849-4f99-b321-fc03fa879cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:02.718544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd610ac-1849-4f99-b321-fc03fa879cce None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:02.719013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd610ac-1849-4f99-b321-fc03fa879cce None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:02.719468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd610ac-1849-4f99-b321-fc03fa879cce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:02.721049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd610ac-1849-4f99-b321-fc03fa879cce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:02.723146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd610ac-1849-4f99-b321-fc03fa879cce None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:02.748714 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 401/816] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:00:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:00:02.749905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd610ac-1849-4f99-b321-fc03fa879cce None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:02.850460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576917d9-5582-429b-be87-3bf5646b727e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:02.908869 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157902a4-30e5-4e06-9760-03ed7c8f534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:02.909947 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157902a4-30e5-4e06-9760-03ed7c8f534f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:02.910418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157902a4-30e5-4e06-9760-03ed7c8f534f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:02.910872 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157902a4-30e5-4e06-9760-03ed7c8f534f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.003543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157902a4-30e5-4e06-9760-03ed7c8f534f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:03.005087 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157902a4-30e5-4e06-9760-03ed7c8f534f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:03.009160 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd610ac-1849-4f99-b321-fc03fa879cce None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:03.062415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a2620-81fe-4bd1-959c-a7078557965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:03.063243 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2620-81fe-4bd1-959c-a7078557965c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.063549 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2620-81fe-4bd1-959c-a7078557965c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.063819 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a2620-81fe-4bd1-959c-a7078557965c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.064548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a2620-81fe-4bd1-959c-a7078557965c None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:03.064902 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a2620-81fe-4bd1-959c-a7078557965c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:03.067430 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a2620-81fe-4bd1-959c-a7078557965c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:03.077185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 402/817] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 14:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:03.078663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407a3c0-a0cd-4482-92e7-4a0c0491de62 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.078951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407a3c0-a0cd-4482-92e7-4a0c0491de62 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.079229 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407a3c0-a0cd-4482-92e7-4a0c0491de62 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.081697 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 403/818] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:03.087173 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407a3c0-a0cd-4482-92e7-4a0c0491de62 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:03.136815 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 416/819] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:00:03.138413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4c3f-93c0-4e56-a6a7-834bd0f80d9a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.138707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4c3f-93c0-4e56-a6a7-834bd0f80d9a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.138987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4c3f-93c0-4e56-a6a7-834bd0f80d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.159707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e38f4c3f-93c0-4e56-a6a7-834bd0f80d9a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:03.161841 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e38f4c3f-93c0-4e56-a6a7-834bd0f80d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:03.242482 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 417/820] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:03.244002 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4c3f-93c0-4e56-a6a7-834bd0f80d9a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:03.260263 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407a3c0-a0cd-4482-92e7-4a0c0491de62 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:03.298397 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:03.299321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.299610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.299885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.311396 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:03.312892 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:03.332307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:03.333338 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:03.335336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:03.335336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:03.335336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:03.335336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:03.335336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 404/821] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:03.335703 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:03.431782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4c3f-93c0-4e56-a6a7-834bd0f80d9a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:03.456404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb5775-9bbc-47f2-98e8-5822e5a1cd1c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:03.488510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:03.490440 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.491630 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.492286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.506463 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a518d2-7660-4ed0-9683-c902f8832947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:03.507695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a518d2-7660-4ed0-9683-c902f8832947 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.508127 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a518d2-7660-4ed0-9683-c902f8832947 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.508546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a518d2-7660-4ed0-9683-c902f8832947 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.509683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:03.511343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:03.525327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a518d2-7660-4ed0-9683-c902f8832947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-46a518d2-7660-4ed0-9683-c902f8832947 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:03.535413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:03.538169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:03.539838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 405/822] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:03.542501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:03.545715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:03.548343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:03.548343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:03.548343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:03.548343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:03.549048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a518d2-7660-4ed0-9683-c902f8832947 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:03.549190 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 418/823] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:03.549190 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:03.677446 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a518d2-7660-4ed0-9683-c902f8832947 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:03.696329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d72c-9251-4047-a29c-6d58e2a4f4d9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:03.732785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:03.733816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.734270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.734720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.735918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:03.736325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:03.738746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:03.750811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:03.751808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.752232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.752642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.761296 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:03.761611 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 406/824] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:03.761765 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:03.761901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:03.762033 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:03.772937 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 419/825] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:03.775781 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:03.898204 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7054a6-f74d-4807-a6cc-db046ed0719d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:03.912504 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b08201-d6cf-4df5-8ad1-77941abd9613 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:03.955280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:03.956462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.956960 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.957413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.959621 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:03.960329 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:03.960590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:03.960912 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:03.961650 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:03.961960 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:03.963360 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:03.969213 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:03.971742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:03.977669 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 407/826] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:03.979266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:04.005116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:04.006734 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:04.007689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:04.008236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 420/827] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:00:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:04.009505 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:04.124204 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51a4f8-0807-46df-8ec7-953712bca4f5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:04.168866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:04.170081 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:04.170362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:04.170635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:04.179046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c8d63-69ae-4406-b671-5ee22fd22239 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:04.184726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:04.186201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:04.208536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:04.218471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:04.220406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:04.220406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:04.220406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:04.220406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:04.220406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 408/828] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:04.220406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:04.239723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:04.242581 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:04.243072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:04.243574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:04.256064 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:04.258905 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:04.286368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:04.287976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:04.288890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:04.288890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:04.288890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:04.288890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:04.288890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:04.288890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:04.288890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:04.288890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:04.293165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 421/829] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:04.294492 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:04.392262 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bbcd3-94cb-488c-95a8-fccc690ed971 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:04.436273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0709a3-d766-4566-a6ea-0db64da72cc5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:04.447809 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:04.449038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:04.449637 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:04.450159 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:04.451915 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:04.452487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:04.455351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:04.489740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 409/830] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 14:00:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:04.489740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:04.503347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:04.504537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:04.505085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:04.505473 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:04.507407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:04.507978 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:04.510564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:04.536555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 422/831] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:04.536555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:04.665988 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a570d-fb78-46ef-a6d2-f99577fbef5f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:04.699896 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec538e23-4b99-411c-81e9-c395867f36ef None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:04.713697 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:04.714376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:04.714662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:04.714921 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:04.715725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:04.716029 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:04.717512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:04.737716 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 410/832] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:04.739764 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:04.764703 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:04.765998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:04.766427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:04.766856 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:04.785128 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:04.788469 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:04.821761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:04.823354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:04.825546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:04.825546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:04.825546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:04.825546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:04.825546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 423/833] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:04.825546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:04.924279 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a89a-3b3c-461f-aee8-a067f44d40a1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:04.976085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7c4e5-c504-4397-b03d-4fb23a20c241 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:04.987549 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:04.988887 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:04.990089 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:04.991175 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.004607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:05.007726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:05.032081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:05.032793 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.033077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.033352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.034219 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=c40d0702d56d47b48afc200b4de3027f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:05.034441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:05.035358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 14:00:05.036315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:05.037899 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:05.037899 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:05.038236 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 411/834] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:00:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:05.038450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:05.061132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 424/835] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:04 2022] GET /identity/v3/role_assignments?user.id=c40d0702d56d47b48afc200b4de3027f&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=52bf3a299728408b8384e30e08547fd8 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:05.061132 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:05.187551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7502a77-5df7-4891-86d8-614298976fda None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:05.211314 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264cf70-ca6d-4a3f-9c6c-e3438f039cd2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:05.229792 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab1db9-777b-49f2-83e6-427f68eb89fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:05.230480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1db9-777b-49f2-83e6-427f68eb89fd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.230763 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1db9-777b-49f2-83e6-427f68eb89fd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.231043 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1db9-777b-49f2-83e6-427f68eb89fd None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.231789 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1db9-777b-49f2-83e6-427f68eb89fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:05.232096 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1db9-777b-49f2-83e6-427f68eb89fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:05.233537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1db9-777b-49f2-83e6-427f68eb89fd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:05.253154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 412/836] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:05.253154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19153a2-e95b-45c1-b72c-44956845ea80 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.253154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19153a2-e95b-45c1-b72c-44956845ea80 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.253154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19153a2-e95b-45c1-b72c-44956845ea80 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.253154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 413/837] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:05.258174 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19153a2-e95b-45c1-b72c-44956845ea80 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:05.268214 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf845d-1d24-482a-bcc7-34d225aafc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:05.269444 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf845d-1d24-482a-bcc7-34d225aafc02 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.269946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf845d-1d24-482a-bcc7-34d225aafc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.270442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf845d-1d24-482a-bcc7-34d225aafc02 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.272632 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf845d-1d24-482a-bcc7-34d225aafc02 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:05.273234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf845d-1d24-482a-bcc7-34d225aafc02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:05.275999 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf845d-1d24-482a-bcc7-34d225aafc02 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:05.314327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 425/838] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 14:00:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:05.314327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597bf5f-6593-4ea5-863c-d56f015bff3c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.314327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597bf5f-6593-4ea5-863c-d56f015bff3c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.314327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597bf5f-6593-4ea5-863c-d56f015bff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.336987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8597bf5f-6593-4ea5-863c-d56f015bff3c None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:05.338624 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8597bf5f-6593-4ea5-863c-d56f015bff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:05.405196 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19153a2-e95b-45c1-b72c-44956845ea80 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:05.438705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 426/839] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:05.439988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597bf5f-6593-4ea5-863c-d56f015bff3c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:05.465225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:05.466509 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.466969 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.467427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.480051 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:05.482622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:05.508568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:05.511133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 414/840] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:05.516303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:05.600081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597bf5f-6593-4ea5-863c-d56f015bff3c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:05.649115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67081b42-7431-430b-8c90-1326b436449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:05.649824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67081b42-7431-430b-8c90-1326b436449f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.650298 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67081b42-7431-430b-8c90-1326b436449f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.650588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67081b42-7431-430b-8c90-1326b436449f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.684907 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93342d07-8e48-4e68-93d6-36baa8137168 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:05.729074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:05.730870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.731600 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.732122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.733476 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:05.736199 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:05.745160 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67081b42-7431-430b-8c90-1326b436449f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:05.746667 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67081b42-7431-430b-8c90-1326b436449f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:05.759666 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:05.761560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:05.763752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 415/841] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:05.765631 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:05.880222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 427/842] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:00:05.882361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67081b42-7431-430b-8c90-1326b436449f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:05.916640 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9340-d31a-4132-9726-58db1f07d72e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:05.974856 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:05.975762 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:05.976143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:05.976808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:05.977762 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:05.978182 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:05.979902 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:06.002897 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 416/843] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:06.002897 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:06.037493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67081b42-7431-430b-8c90-1326b436449f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:06.100490 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:06.101949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:06.102450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:06.102956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:06.104312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:06.104892 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:06.107501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:06.121103 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 428/844] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:06.121103 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:06.164058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4fddd-512c-43fa-9017-1de3c5b8b019 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:06.215437 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:06.217063 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:06.217667 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:06.218300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:06.239005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:06.243685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cdbba-c199-4222-b37a-24fad2c88061 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:06.245562 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:06.283750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:06.284850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:06.285870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:06.285870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:06.285870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:06.285870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:06.286150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e1d1-f626-4d1a-8724-3c55eb7283bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:06.286150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e1d1-f626-4d1a-8724-3c55eb7283bd None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:06.286326 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e1d1-f626-4d1a-8724-3c55eb7283bd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:06.286703 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e1d1-f626-4d1a-8724-3c55eb7283bd None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/7616958327124128a02166a27c462312/roles/800436bc9e734eb38844e9544c3dc7bc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:06.294004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 417/845] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:06.294004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:06.311095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10e1d1-f626-4d1a-8724-3c55eb7283bd None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=7616958327124128a02166a27c462312, role_id=800436bc9e734eb38844e9544c3dc7bc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:06.312659 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10e1d1-f626-4d1a-8724-3c55eb7283bd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:06.328093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 429/846] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:00:06 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/7616958327124128a02166a27c462312/roles/800436bc9e734eb38844e9544c3dc7bc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:00:06.341650 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e1d1-f626-4d1a-8724-3c55eb7283bd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:06.478680 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e1d1-f626-4d1a-8724-3c55eb7283bd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:06.487002 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65f20-15e3-46c7-9a94-510d95980408 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:06.521151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:06.522358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:06.522987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:06.523431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:06.524347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:06.524865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:06.526482 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:06.540754 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 430/847] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:06.551645 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:06.559213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:06.560592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:06.561099 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:06.561559 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:06.562467 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:06.562976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:06.564578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:06.571155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 418/848] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:06.706330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cabb4e-18da-43ee-915b-3a8e5397baeb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:06.746641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:06.747462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:06.747742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:06.748017 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:06.756234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:06.758004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:06.774847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:06.775806 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:06.777240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 431/849] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:06.782317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:06.894134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3d3b3-2c5c-4210-8666-08be01da7485 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:06.932593 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd31069-358c-43eb-8923-dfc29d34b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:06.933298 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31069-358c-43eb-8923-dfc29d34b44a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:06.933582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31069-358c-43eb-8923-dfc29d34b44a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:06.933926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31069-358c-43eb-8923-dfc29d34b44a None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:06.934734 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd31069-358c-43eb-8923-dfc29d34b44a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:06.935044 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd31069-358c-43eb-8923-dfc29d34b44a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:06.936477 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd31069-358c-43eb-8923-dfc29d34b44a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:06.956711 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 419/850] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:06.956962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:07.072714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca90a98-8b7c-483d-8b2f-9254cf6ef72e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:07.111530 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf2f6c-a27f-40bd-8cfe-52f0d6a34e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:07.112211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2f6c-a27f-40bd-8cfe-52f0d6a34e6c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:07.112485 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2f6c-a27f-40bd-8cfe-52f0d6a34e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:07.112891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2f6c-a27f-40bd-8cfe-52f0d6a34e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:07.113887 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf2f6c-a27f-40bd-8cfe-52f0d6a34e6c None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=0734d46e1f4c4994a03d56f0591dfded) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:07.114214 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf2f6c-a27f-40bd-8cfe-52f0d6a34e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:07.115830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf2f6c-a27f-40bd-8cfe-52f0d6a34e6c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:07.123540 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 432/851] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:06 2022] GET /identity/v3/role_assignments?user.id=0734d46e1f4c4994a03d56f0591dfded&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=52bf3a299728408b8384e30e08547fd8 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:07.583783 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca24db-5fbc-4ebd-bf36-d4932bb66285 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:07.584866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca24db-5fbc-4ebd-bf36-d4932bb66285 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:07.584866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca24db-5fbc-4ebd-bf36-d4932bb66285 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:07.586497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 420/852] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:07.592797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e5b1-007d-4ba0-ba15-167f4431d883 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:07.592990 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e5b1-007d-4ba0-ba15-167f4431d883 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:07.593278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e5b1-007d-4ba0-ba15-167f4431d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:07.612400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f054e5b1-007d-4ba0-ba15-167f4431d883 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:07.613675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f054e5b1-007d-4ba0-ba15-167f4431d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:07.693352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 433/853] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:07.716152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca24db-5fbc-4ebd-bf36-d4932bb66285 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:07.849185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca24db-5fbc-4ebd-bf36-d4932bb66285 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:07.887589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:07.888429 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:07.888747 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:07.889026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:07.889691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:07.891074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:07.910217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:07.912024 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:07.915412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 421/854] 10.222.0.13 () {56 vars in 1132 bytes} [Mon May 16 14:00:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:07.926479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054e5b1-007d-4ba0-ba15-167f4431d883 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:08.113361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054e5b1-007d-4ba0-ba15-167f4431d883 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:08.174210 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8551e-7a9c-4032-acbd-299abffcea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:08.175852 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8551e-7a9c-4032-acbd-299abffcea94 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:08.176627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8551e-7a9c-4032-acbd-299abffcea94 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:08.177439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8551e-7a9c-4032-acbd-299abffcea94 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:08.179164 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8551e-7a9c-4032-acbd-299abffcea94 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:08.179990 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8551e-7a9c-4032-acbd-299abffcea94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:08.182924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8551e-7a9c-4032-acbd-299abffcea94 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:08.192210 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 434/855] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:08.201616 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:08.370341 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997808cf-8bb7-4599-bc4b-7721909c519e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:08.421194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75eb96-ae8e-44b0-9299-eb5b0f5713f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:08.422631 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75eb96-ae8e-44b0-9299-eb5b0f5713f0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:08.423182 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75eb96-ae8e-44b0-9299-eb5b0f5713f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:08.423705 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75eb96-ae8e-44b0-9299-eb5b0f5713f0 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:08.424642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75eb96-ae8e-44b0-9299-eb5b0f5713f0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:08.425179 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75eb96-ae8e-44b0-9299-eb5b0f5713f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:08.426802 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75eb96-ae8e-44b0-9299-eb5b0f5713f0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:08.432982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 422/856] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:09.033357 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd48629-6aae-495d-aac8-ac68da4592dc None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.034082 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd48629-6aae-495d-aac8-ac68da4592dc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.034217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd48629-6aae-495d-aac8-ac68da4592dc None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.036792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 435/857] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:09.045595 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596469e-af5e-40c6-8542-e8390c490daf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.046392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596469e-af5e-40c6-8542-e8390c490daf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.046392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596469e-af5e-40c6-8542-e8390c490daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.071268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a596469e-af5e-40c6-8542-e8390c490daf None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:09.072737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a596469e-af5e-40c6-8542-e8390c490daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:09.160950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 423/858] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:09.179849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd48629-6aae-495d-aac8-ac68da4592dc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:09.315182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd48629-6aae-495d-aac8-ac68da4592dc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:09.371823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c344b6c-ec5f-4f67-94f2-52aa03c23543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:09.373513 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344b6c-ec5f-4f67-94f2-52aa03c23543 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.374290 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344b6c-ec5f-4f67-94f2-52aa03c23543 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.375031 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344b6c-ec5f-4f67-94f2-52aa03c23543 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.376769 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c344b6c-ec5f-4f67-94f2-52aa03c23543 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:09.379883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c344b6c-ec5f-4f67-94f2-52aa03c23543 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:09.408120 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 436/859] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:00:09 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:00:09.480926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135bcb-837a-4857-87d1-53de95a029d7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.481390 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135bcb-837a-4857-87d1-53de95a029d7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.481754 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135bcb-837a-4857-87d1-53de95a029d7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.484897 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 424/860] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:09.494541 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3c5a-664b-462c-9392-f93edb7df0c2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.495004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3c5a-664b-462c-9392-f93edb7df0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.495492 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e3c5a-664b-462c-9392-f93edb7df0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.525825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f33e3c5a-664b-462c-9392-f93edb7df0c2 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:09.527959 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f33e3c5a-664b-462c-9392-f93edb7df0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:09.597469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bce8a2-5c20-4859-a1ce-4f73111ba569 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.597892 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bce8a2-5c20-4859-a1ce-4f73111ba569 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.598070 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bce8a2-5c20-4859-a1ce-4f73111ba569 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.599722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 425/861] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:09.606302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a92481-3275-46e9-a40f-066f9f59abbf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.606696 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a92481-3275-46e9-a40f-066f9f59abbf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.606965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a92481-3275-46e9-a40f-066f9f59abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.627495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-08a92481-3275-46e9-a40f-066f9f59abbf None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:09.628722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-08a92481-3275-46e9-a40f-066f9f59abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:09.660109 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 437/862] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:09.688034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e3c5a-664b-462c-9392-f93edb7df0c2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:09.729797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 426/863] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:09.755397 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a92481-3275-46e9-a40f-066f9f59abbf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:09.811656 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e3c5a-664b-462c-9392-f93edb7df0c2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:09.857947 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386f57e-6313-4b81-b645-9fe420784f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:09.858812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f57e-6313-4b81-b645-9fe420784f4d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.859381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f57e-6313-4b81-b645-9fe420784f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.859508 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f57e-6313-4b81-b645-9fe420784f4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.862886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a92481-3275-46e9-a40f-066f9f59abbf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:09.871249 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386f57e-6313-4b81-b645-9fe420784f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f386f57e-6313-4b81-b645-9fe420784f4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:09.879282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:09.880294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:09.881956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 438/864] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 14:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:09.886791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386f57e-6313-4b81-b645-9fe420784f4d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:09.915091 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:09.915979 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:09.916264 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:09.916537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:09.917272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:09.918714 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:09.934337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:09.935370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:09.936207 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:09.939206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 427/865] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:09.945582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:10.004325 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386f57e-6313-4b81-b645-9fe420784f4d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:10.043786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:10.045226 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:10.045663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:10.046086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:10.047040 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:10.047506 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:10.049119 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:10.053928 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913198f-ecc3-4ec9-b73a-06eb0811fd5e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:10.064786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 439/866] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 14:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:10.066490 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:10.092290 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:10.093172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:10.093679 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:10.094176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:10.095137 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:10.095779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:10.097415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:10.108902 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 428/867] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:10.110213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:10.174810 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e0f3-8a83-4e05-887c-5d6838e1114d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:10.211371 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:10.212431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:10.212889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:10.213385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:10.216874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ce739-4158-41e1-9e61-e5a66cd54f23 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:10.227126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:10.229177 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:10.247796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:10.249102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:10.249995 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:10.249995 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:10.249995 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:10.249995 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:10.256969 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:10.256969 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:10.256969 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:10.256969 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:10.257385 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:10.257385 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:10.257776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 440/868] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:10.257966 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:10.259542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:10.268796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 429/869] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:10.377983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c651-25ba-4ad9-8112-7158ca57928d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:10.416467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:10.417601 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:10.418085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:10.418585 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:10.419524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:10.420047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:10.421679 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:10.440120 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 441/870] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:10.445841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:10.551645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374fdd0-5c8e-495b-9987-aa3545a2aff4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:10.589083 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:10.590213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:10.590515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:10.590819 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:10.599386 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:10.601594 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:10.618411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:10.619431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:10.620544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 430/871] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:00:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:10.627545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:10.746457 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d6bc-f20a-4cbd-8d37-186d2d6dcafc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:10.784560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:10.785277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:10.785561 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:10.785839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:10.786686 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:10.786994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:10.789547 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:10.810221 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 442/872] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 14:00:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:10.815997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:10.932061 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90520ba2-f1a1-4f21-a9fb-3000b1cdae0b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:10.971320 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5acaa-2bd1-42a2-8f64-30d4ff51d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:10.971991 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5acaa-2bd1-42a2-8f64-30d4ff51d68d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:10.972272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5acaa-2bd1-42a2-8f64-30d4ff51d68d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:10.972551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5acaa-2bd1-42a2-8f64-30d4ff51d68d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.045072 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5acaa-2bd1-42a2-8f64-30d4ff51d68d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:11.046529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5acaa-2bd1-42a2-8f64-30d4ff51d68d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:11.160200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 431/873] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:10 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:00:11.166604 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:11.273776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c8fa4-b813-4cb8-bcdc-812423206651 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:11.300313 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394e22-429e-41f9-9cc8-5dc487dae007 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.300847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394e22-429e-41f9-9cc8-5dc487dae007 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.301295 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394e22-429e-41f9-9cc8-5dc487dae007 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.303688 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 432/874] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:11.309661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba192-f83a-463f-a78d-0923dc23e657 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.310268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba192-f83a-463f-a78d-0923dc23e657 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.310740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba192-f83a-463f-a78d-0923dc23e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.311987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:11.312815 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.313098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.313368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.325241 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:11.326847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:11.329553 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-db8ba192-f83a-463f-a78d-0923dc23e657 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:11.331791 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-db8ba192-f83a-463f-a78d-0923dc23e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:11.353958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:11.354920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:11.355789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:11.355789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:11.355789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:11.355789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:11.355789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 443/875] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:11.367628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:11.417635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 433/876] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:11.440602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ba192-f83a-463f-a78d-0923dc23e657 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:11.496425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef701a-1be8-4ce2-a7dc-6acbca96d757 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:11.534543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:11.535576 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.536055 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.536610 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.538259 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:11.538784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:11.540382 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:11.554136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 444/877] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:11.559340 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:11.573280 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ba192-f83a-463f-a78d-0923dc23e657 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:11.612838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a24640-1807-4923-b9c3-4882cf52ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:11.613874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24640-1807-4923-b9c3-4882cf52ade3 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.614373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24640-1807-4923-b9c3-4882cf52ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.614882 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a24640-1807-4923-b9c3-4882cf52ade3 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.616011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a24640-1807-4923-b9c3-4882cf52ade3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:11.617621 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a24640-1807-4923-b9c3-4882cf52ade3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:11.637165 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 434/878] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:00:11 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:00:11.680564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0e5d0-79fb-4fd9-96f5-1265ebb24eb3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:11.730835 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37c18-ee98-4e61-9c55-eebc05aac641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:11.731800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37c18-ee98-4e61-9c55-eebc05aac641 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.732086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37c18-ee98-4e61-9c55-eebc05aac641 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.732360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37c18-ee98-4e61-9c55-eebc05aac641 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.741591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37c18-ee98-4e61-9c55-eebc05aac641 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:11.743255 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37c18-ee98-4e61-9c55-eebc05aac641 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-89f37c18-ee98-4e61-9c55-eebc05aac641 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:11.764180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:11.765186 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:11.766084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:11.766084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:11.766084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:11.766084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:11.766084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:11.766084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:11.766084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:11.766084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:11.766507 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 445/879] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:11.773805 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a24640-1807-4923-b9c3-4882cf52ade3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:11.895365 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a24640-1807-4923-b9c3-4882cf52ade3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:11.935523 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98281b3-f744-49d2-b290-bc84a727e4b1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.935853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98281b3-f744-49d2-b290-bc84a727e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.936058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98281b3-f744-49d2-b290-bc84a727e4b1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.937235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:11.937867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 446/880] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:11.938036 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.938202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.938876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.939705 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:11.940017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:11.941697 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:11.946987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57df4-8619-4791-8eee-3c1cf74df2b5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:11.947291 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57df4-8619-4791-8eee-3c1cf74df2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:11.947627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57df4-8619-4791-8eee-3c1cf74df2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:11.958329 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 435/881] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:11.965787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:11.967805 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-53b57df4-8619-4791-8eee-3c1cf74df2b5 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:11.970315 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-53b57df4-8619-4791-8eee-3c1cf74df2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:12.058238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 447/882] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:12.080924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b57df4-8619-4791-8eee-3c1cf74df2b5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:12.088498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe2f9-0a34-4327-95d6-c1acf20e5041 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:12.139111 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:12.140601 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:12.141073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:12.141792 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:12.143151 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=7616958327124128a02166a27c462312) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:12.144236 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:12.147335 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:12.165364 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 436/883] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:11 2022] GET /identity/v3/role_assignments?user.id=7616958327124128a02166a27c462312&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:12.199460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b57df4-8619-4791-8eee-3c1cf74df2b5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:12.242830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:12.243654 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:12.243928 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:12.244195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:12.244883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:12.246356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:12.259481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:12.260525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:12.261401 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 448/884] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:12.267256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:12.388831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c66e7a-0e92-40e6-8487-87f3def2b455 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:12.425685 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:12.426901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:12.427395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:12.427883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:12.429397 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:12.429955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:12.431647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:12.438052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 437/885] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:12.446449 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:12.641190 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8683c-6931-4438-b925-1c71b8074d72 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:12.705903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20a740-046a-4f8b-b9dc-06e71720b9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:12.707505 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a740-046a-4f8b-b9dc-06e71720b9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:12.708290 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a740-046a-4f8b-b9dc-06e71720b9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:12.709133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a740-046a-4f8b-b9dc-06e71720b9d0 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:12.710512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20a740-046a-4f8b-b9dc-06e71720b9d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:12.711232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20a740-046a-4f8b-b9dc-06e71720b9d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:12.713776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20a740-046a-4f8b-b9dc-06e71720b9d0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:12.723818 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 449/886] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:12.731085 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:12.748374 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f074-3d19-4e38-a829-4c2a7ed61436 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:12.748919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f074-3d19-4e38-a829-4c2a7ed61436 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:12.749414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f074-3d19-4e38-a829-4c2a7ed61436 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:12.752462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 450/887] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:12.763045 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150873-947f-4e93-b029-4572fcffbda0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:12.763520 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150873-947f-4e93-b029-4572fcffbda0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:12.766076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150873-947f-4e93-b029-4572fcffbda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:12.796725 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c0150873-947f-4e93-b029-4572fcffbda0 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:12.798826 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c0150873-947f-4e93-b029-4572fcffbda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:12.921257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e27ed5-4b12-4bfb-bb28-5980b4d53b3f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:12.946559 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 451/888] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:12.969420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:12.970446 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:12.970931 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:12.971428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:12.972432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] RBAC: Adding query filter params (interface=public, service_id=a1b7a7183d95441ea5d3bf95e94a93f8, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:12.973019 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:12.974756 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:12.984323 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 438/889] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 14:00:12 2022] GET /identity/v3/endpoints?service_id=a1b7a7183d95441ea5d3bf95e94a93f8&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:12.992710 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150873-947f-4e93-b029-4572fcffbda0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:12.992896 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:13.118613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeca7b-ccbb-4409-b8c8-73e59703b402 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:13.162461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e1a1e-0b1a-4ff8-a872-c28858c82609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:13.163719 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e1a1e-0b1a-4ff8-a872-c28858c82609 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:13.164241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e1a1e-0b1a-4ff8-a872-c28858c82609 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:13.165019 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e1a1e-0b1a-4ff8-a872-c28858c82609 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:13.166135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e1a1e-0b1a-4ff8-a872-c28858c82609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:13.168332 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e1a1e-0b1a-4ff8-a872-c28858c82609 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:13.175790 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 439/890] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 14:00:12 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 14:00:13.215489 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150873-947f-4e93-b029-4572fcffbda0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:13.286720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ccbbd-d340-4c0c-85cf-0d34e9d91b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:13.288535 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ccbbd-d340-4c0c-85cf-0d34e9d91b14 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:13.289274 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ccbbd-d340-4c0c-85cf-0d34e9d91b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:13.289988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ccbbd-d340-4c0c-85cf-0d34e9d91b14 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:13.291376 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ccbbd-d340-4c0c-85cf-0d34e9d91b14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:13.294164 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ccbbd-d340-4c0c-85cf-0d34e9d91b14 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:13.335395 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 452/891] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:00:12 2022] POST /identity/v3/services => generated 241 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:00:14.403891 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c4c6-9413-4747-b656-04bc0bdec00e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:14.404741 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c4c6-9413-4747-b656-04bc0bdec00e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:14.404741 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c4c6-9413-4747-b656-04bc0bdec00e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:14.406168 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 440/892] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:14.412112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c611d-cf53-45d9-b9ef-929ee874f903 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:14.412756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c611d-cf53-45d9-b9ef-929ee874f903 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:14.412756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c611d-cf53-45d9-b9ef-929ee874f903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:14.431514 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1d7c611d-cf53-45d9-b9ef-929ee874f903 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:14.433155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d7c611d-cf53-45d9-b9ef-929ee874f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:14.522938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 453/893] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:14.544961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c4c6-9413-4747-b656-04bc0bdec00e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:14.697497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c4c6-9413-4747-b656-04bc0bdec00e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:14.769522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:14.771384 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:14.772235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:14.773074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:14.774657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:14.777536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:14.802468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:14.804946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:14.806550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:14.813933 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 441/894] 10.222.0.13 () {56 vars in 1132 bytes} [Mon May 16 14:00:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:14.823633 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c611d-cf53-45d9-b9ef-929ee874f903 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:14.941669 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c611d-cf53-45d9-b9ef-929ee874f903 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:14.980089 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92c617-cc35-4c1d-9cf2-898f3c6659de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:14.980691 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c617-cc35-4c1d-9cf2-898f3c6659de None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:14.980957 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c617-cc35-4c1d-9cf2-898f3c6659de None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:14.981244 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c617-cc35-4c1d-9cf2-898f3c6659de None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:14.981972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92c617-cc35-4c1d-9cf2-898f3c6659de None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:14.982324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92c617-cc35-4c1d-9cf2-898f3c6659de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:14.983718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92c617-cc35-4c1d-9cf2-898f3c6659de None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:14.989571 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 454/895] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:14.998589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:15.114854 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0efd0-5a5b-45c4-988d-8ae036411318 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.115504 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0efd0-5a5b-45c4-988d-8ae036411318 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.116582 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0efd0-5a5b-45c4-988d-8ae036411318 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.118982 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 455/896] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:15.124872 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b80c-c792-4995-8cb5-48e2e281ee32 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.125479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b80c-c792-4995-8cb5-48e2e281ee32 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.125967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b80c-c792-4995-8cb5-48e2e281ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.161847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8553b80c-c792-4995-8cb5-48e2e281ee32 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:15.163518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c7a2-7a87-42c2-a6b1-f7bd03c7a08e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:15.164875 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8553b80c-c792-4995-8cb5-48e2e281ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:15.203650 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:15.204711 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.205208 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.205670 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.206846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:15.207358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:15.210034 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:15.217260 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 442/897] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:15.227840 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:15.279195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 456/898] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:15.305199 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553b80c-c792-4995-8cb5-48e2e281ee32 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:15.363626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e299a26-18cf-4777-8dae-19b259af79c3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:15.405271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:15.405956 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.406223 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.406672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.407648 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] RBAC: Adding query filter params (interface=public, service_id=b18aad104e724ee695a8427b751d1092, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:15.408135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:15.409767 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:15.420775 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 443/899] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 14:00:15 2022] GET /identity/v3/endpoints?service_id=b18aad104e724ee695a8427b751d1092&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:15.423718 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:15.453351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553b80c-c792-4995-8cb5-48e2e281ee32 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:15.502874 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c883a3-5ecb-4b83-ab3e-5a2a2d7b51f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:15.504580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c883a3-5ecb-4b83-ab3e-5a2a2d7b51f5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.505062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c883a3-5ecb-4b83-ab3e-5a2a2d7b51f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.505483 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c883a3-5ecb-4b83-ab3e-5a2a2d7b51f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.520883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c883a3-5ecb-4b83-ab3e-5a2a2d7b51f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e5c883a3-5ecb-4b83-ab3e-5a2a2d7b51f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:15.531704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:15.532895 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:15.533904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:15.536995 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 457/900] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 14:00:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:15.544877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c883a3-5ecb-4b83-ab3e-5a2a2d7b51f5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:15.550826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f801c-021d-42f7-8c84-4237342c7902 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:15.589545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4a87e-5bd8-42d7-9332-a33f436ddf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:15.590714 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4a87e-5bd8-42d7-9332-a33f436ddf68 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.591213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4a87e-5bd8-42d7-9332-a33f436ddf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.591688 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4a87e-5bd8-42d7-9332-a33f436ddf68 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.592869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4a87e-5bd8-42d7-9332-a33f436ddf68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:15.595378 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4a87e-5bd8-42d7-9332-a33f436ddf68 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:15.608710 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 444/901] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 14:00:15 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 14:00:15.704268 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c883a3-5ecb-4b83-ab3e-5a2a2d7b51f5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:15.771726 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe3bc5-1827-4003-afc1-b4fcc1dc7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:15.773967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe3bc5-1827-4003-afc1-b4fcc1dc7c3a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.774524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe3bc5-1827-4003-afc1-b4fcc1dc7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.775010 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe3bc5-1827-4003-afc1-b4fcc1dc7c3a None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.776533 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe3bc5-1827-4003-afc1-b4fcc1dc7c3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:15.777076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe3bc5-1827-4003-afc1-b4fcc1dc7c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:15.779694 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe3bc5-1827-4003-afc1-b4fcc1dc7c3a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:15.797451 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 458/902] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 14:00:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:15.807358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4a87e-5bd8-42d7-9332-a33f436ddf68 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:15.837563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde6be-aa09-4249-bd6d-3dbdb987426b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.837827 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde6be-aa09-4249-bd6d-3dbdb987426b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.838209 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde6be-aa09-4249-bd6d-3dbdb987426b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.839939 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 459/903] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:15.846182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9c3f-edf2-45b6-b57b-9838cd9ab634 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:15.846475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9c3f-edf2-45b6-b57b-9838cd9ab634 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:15.846860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9c3f-edf2-45b6-b57b-9838cd9ab634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:15.870157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bcfd9c3f-edf2-45b6-b57b-9838cd9ab634 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:15.871726 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bcfd9c3f-edf2-45b6-b57b-9838cd9ab634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:15.976875 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4a87e-5bd8-42d7-9332-a33f436ddf68 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:16.016831 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 460/904] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:16.040686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:16.041661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.041948 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.042224 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.047534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd9c3f-edf2-45b6-b57b-9838cd9ab634 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:16.059190 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:16.060806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:16.084317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:16.086098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:16.089981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:16.089981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:16.089981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:16.089981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:16.089981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 445/905] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:16.099125 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:16.259752 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd9c3f-edf2-45b6-b57b-9838cd9ab634 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:16.324803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6c5ef-37b1-43aa-bd01-673d7965880f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:16.332507 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:16.333990 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.334658 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.335715 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.337071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:16.339750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:16.376794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:16.378664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:16.380297 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 461/906] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:16.383519 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:16.392332 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a5bcc-d2c9-4ed0-9864-0e603a553aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:16.393050 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5bcc-d2c9-4ed0-9864-0e603a553aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.393332 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5bcc-d2c9-4ed0-9864-0e603a553aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.393608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5bcc-d2c9-4ed0-9864-0e603a553aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.394343 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a5bcc-d2c9-4ed0-9864-0e603a553aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:16.394646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a5bcc-d2c9-4ed0-9864-0e603a553aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:16.396017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a5bcc-d2c9-4ed0-9864-0e603a553aa7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:16.409613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 446/907] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:16.409613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f68a-4e0e-443d-81f9-163c5a02e5df None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.409613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f68a-4e0e-443d-81f9-163c5a02e5df None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.409613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f68a-4e0e-443d-81f9-163c5a02e5df None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.409613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 447/908] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:16.420119 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5e454-24b1-4437-83d6-52cfb95effcd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.420452 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5e454-24b1-4437-83d6-52cfb95effcd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.420874 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5e454-24b1-4437-83d6-52cfb95effcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.439884 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-01a5e454-24b1-4437-83d6-52cfb95effcd None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:16.441657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-01a5e454-24b1-4437-83d6-52cfb95effcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:16.520151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aa49b-1565-431e-af64-eb8eb764360e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:16.532842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 448/909] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:16.532842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5e454-24b1-4437-83d6-52cfb95effcd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:16.589835 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:16.590566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.591018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.591539 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.592705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:16.593212 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:16.595649 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:16.609479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 462/910] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:16.609479 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:16.697730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5e454-24b1-4437-83d6-52cfb95effcd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:16.742813 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:16.743687 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.743967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.744242 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.752539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:16.754087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:16.771388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:16.781507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 449/911] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:00:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:16.783296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:16.786905 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc33d7-210a-4b75-ade3-1daf9659798c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:16.832769 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:16.834608 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.835845 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.836340 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.837634 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:16.840380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:16.864102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:16.865334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:00:16.866304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:16.867258 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 463/912] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:16.868529 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:16.923619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d73f0-c604-4016-9bf2-809fbd4f76b9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:16.968478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:16.969478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:16.969868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:16.970809 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:16.971501 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:16.972018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:16.974659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:16.983829 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 450/913] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:16.985053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:17.022573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639e46b-ebb4-456e-a148-626af98aac69 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:17.080780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:17.081844 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:17.082284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:17.082718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:17.084302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:17.084940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:17.087364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:17.098515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90d52-d8a6-44a7-93e1-377a84cdd719 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:17.117714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 464/914] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 14:00:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:17.117714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:17.162336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:17.164004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:17.164504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:17.165055 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:17.166334 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:17.166830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:17.169352 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:17.182928 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 451/915] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:17.182928 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:17.270491 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e99ff-7442-408e-939a-907c550fae38 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:17.320328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:17.321509 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:17.321998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:17.322480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:17.323985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] RBAC: Adding query filter params (interface=public, service_id=10b4bed4f53746748c805f4ffe8af0cc, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:17.324545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:17.327148 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:17.341014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 465/916] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 14:00:17 2022] GET /identity/v3/endpoints?service_id=10b4bed4f53746748c805f4ffe8af0cc&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:17.341014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:17.362757 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a688-e01e-40a5-97f8-c7bb385417fa None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:17.401136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c3f8-1df9-48f7-aea1-53f009165d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:17.401796 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c3f8-1df9-48f7-aea1-53f009165d63 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:17.402073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c3f8-1df9-48f7-aea1-53f009165d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:17.402345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c3f8-1df9-48f7-aea1-53f009165d63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:17.500802 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10c3f8-1df9-48f7-aea1-53f009165d63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:17.502982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10c3f8-1df9-48f7-aea1-53f009165d63 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:17.503176 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8533756-0c7c-447b-9458-2a5deabb4bce None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:17.556127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:17.557200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:17.557633 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:17.558039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:17.558952 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:17.559394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:17.560983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:17.572868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 466/917] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 14:00:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:17.572868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:17.624952 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 452/918] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:00:17.626745 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c3f8-1df9-48f7-aea1-53f009165d63 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:17.717286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97220-5f53-446e-9c0b-12939223b99a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:17.770211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553527fa-10fa-4e3c-9d69-485bd4b26ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:17.771240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553527fa-10fa-4e3c-9d69-485bd4b26ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:17.771710 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553527fa-10fa-4e3c-9d69-485bd4b26ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:17.772235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553527fa-10fa-4e3c-9d69-485bd4b26ed6 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:17.774050 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553527fa-10fa-4e3c-9d69-485bd4b26ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:17.775819 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553527fa-10fa-4e3c-9d69-485bd4b26ed6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:17.777100 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c3f8-1df9-48f7-aea1-53f009165d63 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:17.783551 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 467/919] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 14:00:17 2022] GET /identity/v3/services => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:00:17.785253 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553527fa-10fa-4e3c-9d69-485bd4b26ed6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:17.817048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef5ab8-9124-4cbe-8242-9ad0426db0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:17.817730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef5ab8-9124-4cbe-8242-9ad0426db0a1 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:17.818009 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef5ab8-9124-4cbe-8242-9ad0426db0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:17.818283 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef5ab8-9124-4cbe-8242-9ad0426db0a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:17.819059 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef5ab8-9124-4cbe-8242-9ad0426db0a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:17.820497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef5ab8-9124-4cbe-8242-9ad0426db0a1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:17.852714 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 453/920] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:00:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:00:17.952095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553527fa-10fa-4e3c-9d69-485bd4b26ed6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:18.002386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:18.003203 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:18.003515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:18.003775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:18.016025 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:18.017562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:18.037442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:18.039879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:18.042163 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:18.042163 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:18.042163 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:18.042163 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:18.042163 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 468/921] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:18.045199 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef5ab8-9124-4cbe-8242-9ad0426db0a1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:18.166561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef5ab8-9124-4cbe-8242-9ad0426db0a1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:18.205182 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:18.205869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:18.206152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:18.206435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:18.207180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:18.207486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:18.208913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:18.223549 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 454/922] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:18.233354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:18.354940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa41c2c-c786-4ae2-b459-7124f82fd8ad None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:18.392026 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e9a4e-80f4-452c-b1d7-28a66f6f12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:18.392865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9a4e-80f4-452c-b1d7-28a66f6f12e0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:18.393151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9a4e-80f4-452c-b1d7-28a66f6f12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:18.393437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9a4e-80f4-452c-b1d7-28a66f6f12e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:18.402152 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e9a4e-80f4-452c-b1d7-28a66f6f12e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:18.403652 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e9a4e-80f4-452c-b1d7-28a66f6f12e0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-197e9a4e-80f4-452c-b1d7-28a66f6f12e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:18.419580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:18.420596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:18.421903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 469/923] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:18.430379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:18.610419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce857dde-d6db-448f-ade1-16ea0a772239 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:18.613768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd14a2-3dc0-4d27-bed0-f508bd195e2d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:18.615365 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd14a2-3dc0-4d27-bed0-f508bd195e2d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:18.617438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd14a2-3dc0-4d27-bed0-f508bd195e2d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:18.619025 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 470/924] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:18.624655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d9e09-6f62-4ebf-bd46-aec66a69dc5c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:18.625062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d9e09-6f62-4ebf-bd46-aec66a69dc5c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:18.625319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d9e09-6f62-4ebf-bd46-aec66a69dc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:18.652812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fb1d9e09-6f62-4ebf-bd46-aec66a69dc5c None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:18.660617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fb1d9e09-6f62-4ebf-bd46-aec66a69dc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:18.680376 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:18.682007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:18.682816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:18.683623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:18.685545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:18.686407 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:18.689413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:18.712585 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 455/925] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:18.721885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:18.751227 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 471/926] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:18.775333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d9e09-6f62-4ebf-bd46-aec66a69dc5c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:18.881757 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d9e09-6f62-4ebf-bd46-aec66a69dc5c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:18.904616 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3ebcf-3fcb-43da-b7af-65736eef41d6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:18.925752 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:18.926592 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:18.926874 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:18.927150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:18.928126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:18.929642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:18.946030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:18.947908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:00:18.950220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:18.952616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 472/927] 10.222.0.13 () {56 vars in 1132 bytes} [Mon May 16 14:00:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:18.952974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:18.981241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:18.983412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:18.984706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:18.985835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:18.988754 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] RBAC: Adding query filter params (role.id=bb5fe8f8dac0489485dc9f5a8d41d465, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=7616958327124128a02166a27c462312) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:18.989598 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:18.994431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:19.008617 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 456/928] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:18 2022] GET /identity/v3/role_assignments?user.id=7616958327124128a02166a27c462312&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=bb5fe8f8dac0489485dc9f5a8d41d465 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:19.080013 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444b94-1984-4dee-803f-421b0b71119e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:19.119981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:19.120697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:19.120973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:19.121247 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:19.121973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:19.122344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:19.123813 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:19.129701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 473/929] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:19.136115 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:19.298965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34453792-c91f-4f99-a412-ea270c815ec4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:19.341434 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf11c9-3651-461a-ab8a-befcc20929b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:19.342114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf11c9-3651-461a-ab8a-befcc20929b9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:19.342397 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf11c9-3651-461a-ab8a-befcc20929b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:19.342671 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf11c9-3651-461a-ab8a-befcc20929b9 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:19.343385 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf11c9-3651-461a-ab8a-befcc20929b9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:19.343687 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf11c9-3651-461a-ab8a-befcc20929b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:19.345088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf11c9-3651-461a-ab8a-befcc20929b9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:19.352431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 457/930] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:19.358912 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:19.531272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55a60-b04b-445b-805d-8e124bc9801a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:19.599194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe87c8c-2a22-4f90-bc8e-0ce8d6a5abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:19.600882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87c8c-2a22-4f90-bc8e-0ce8d6a5abf7 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:19.601661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87c8c-2a22-4f90-bc8e-0ce8d6a5abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:19.602424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87c8c-2a22-4f90-bc8e-0ce8d6a5abf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:19.604374 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe87c8c-2a22-4f90-bc8e-0ce8d6a5abf7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:19.607253 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe87c8c-2a22-4f90-bc8e-0ce8d6a5abf7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:19.646412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 474/931] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:00:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:00:20.190035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a8433-78f8-408e-9940-a82b37fbcdd2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:20.190833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a8433-78f8-408e-9940-a82b37fbcdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:20.190833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a8433-78f8-408e-9940-a82b37fbcdd2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:20.192379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 458/932] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:20.198713 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381405-52c7-4045-933f-465da6ef3b33 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:20.199077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381405-52c7-4045-933f-465da6ef3b33 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:20.199248 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381405-52c7-4045-933f-465da6ef3b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:20.220704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-91381405-52c7-4045-933f-465da6ef3b33 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:20.221947 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-91381405-52c7-4045-933f-465da6ef3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:20.303245 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 475/933] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:20.326846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a8433-78f8-408e-9940-a82b37fbcdd2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:20.445827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a8433-78f8-408e-9940-a82b37fbcdd2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:20.484586 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:20.485449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:20.485705 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:20.485993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:20.486661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:20.488038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:20.502222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:20.506027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:20.509658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 459/934] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:20.521703 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91381405-52c7-4045-933f-465da6ef3b33 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:20.618957 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91381405-52c7-4045-933f-465da6ef3b33 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:20.657263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:20.658455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:20.658455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:20.658455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:20.659175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:20.664104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:20.664104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:20.667416 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 476/935] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:20.673951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:20.785744 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0c6f2-33cf-4638-b999-0cfa7349238c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:20.824210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154809-3a35-4fe4-91d4-e28081e6861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:20.824923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154809-3a35-4fe4-91d4-e28081e6861b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:20.825192 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154809-3a35-4fe4-91d4-e28081e6861b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:20.825470 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154809-3a35-4fe4-91d4-e28081e6861b None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:20.826173 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154809-3a35-4fe4-91d4-e28081e6861b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:20.826474 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154809-3a35-4fe4-91d4-e28081e6861b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:20.827990 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154809-3a35-4fe4-91d4-e28081e6861b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:20.833968 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 460/936] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:20.840137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:20.952951 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393c59d-cb51-4d40-a71d-055e6768329c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:20.993598 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f9e81-33b9-4489-a5a8-ec48391cd343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:20.994283 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9e81-33b9-4489-a5a8-ec48391cd343 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:20.994546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9e81-33b9-4489-a5a8-ec48391cd343 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:20.994820 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9e81-33b9-4489-a5a8-ec48391cd343 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:20.995601 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f9e81-33b9-4489-a5a8-ec48391cd343 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:20.997086 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f9e81-33b9-4489-a5a8-ec48391cd343 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:21.019128 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 477/937] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:00:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:00:21.208515 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088fbc-5583-4d24-bc4c-32c7e83b7910 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:21.209275 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088fbc-5583-4d24-bc4c-32c7e83b7910 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:21.209275 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088fbc-5583-4d24-bc4c-32c7e83b7910 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:21.211623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 461/938] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:21.217855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd8499-c4a1-48d0-b46e-b34f9b04d7e8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:21.218219 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd8499-c4a1-48d0-b46e-b34f9b04d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:21.218390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd8499-c4a1-48d0-b46e-b34f9b04d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:21.238518 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-92dd8499-c4a1-48d0-b46e-b34f9b04d7e8 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:21.239757 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-92dd8499-c4a1-48d0-b46e-b34f9b04d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:21.345367 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 478/939] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:21.370538 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088fbc-5583-4d24-bc4c-32c7e83b7910 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:21.484238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088fbc-5583-4d24-bc4c-32c7e83b7910 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:21.523862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:21.524540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:21.524856 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:21.525132 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:21.525876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:21.527396 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:21.528818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: WARNING keystone.server.flask.common [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 14:00:21.547770 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.sql.core [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 14:00:21.547770 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 14:00:21.547770 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [parameters: {'id': 'e5cf35c557fb47b189f691c62ff8342c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 14:00:21.547770 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80057) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-aee007e9-cf95-4bc8-9be3-9f0008689a1a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5cf35c557fb47b189f691c62ff8342c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5cf35c557fb47b189f691c62ff8342c. May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:00:21.556489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 14:00:21.558327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application yield resource May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.rollback() May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.force_reraise() May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise self.value May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application session.commit() May 16 14:00:21.560558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._prepare_impl() May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.flush() May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._flush(objects) May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application compat.raise_( May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application flush_context.execute() May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 14:00:21.562699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rec.execute(self) May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 14:00:21.564733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:00:21.566592 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [parameters: {'id': 'e5cf35c557fb47b189f691c62ff8342c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:21.568629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:21.571048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5cf35c557fb47b189f691c62ff8342c. May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:21.573170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 462/940] 10.222.0.13 () {60 vars in 1140 bytes} [Mon May 16 14:00:21 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:21.574449 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd8499-c4a1-48d0-b46e-b34f9b04d7e8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:21.580698 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff965b89-a961-46af-bf5d-3459beda52bf None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:21.580698 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff965b89-a961-46af-bf5d-3459beda52bf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:21.580698 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff965b89-a961-46af-bf5d-3459beda52bf None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:21.586038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 463/941] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:21.587811 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdba9-687c-45fb-9dc8-c4c0c7332fd6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:21.588104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdba9-687c-45fb-9dc8-c4c0c7332fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:21.588385 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdba9-687c-45fb-9dc8-c4c0c7332fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:21.610870 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2e4fdba9-687c-45fb-9dc8-c4c0c7332fd6 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:21.612468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2e4fdba9-687c-45fb-9dc8-c4c0c7332fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:21.684093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd8499-c4a1-48d0-b46e-b34f9b04d7e8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:21.699050 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 464/942] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:21.727175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:21.728754 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fdba9-687c-45fb-9dc8-c4c0c7332fd6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:21.730228 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:21.730724 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:21.731293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:21.741144 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:21.742936 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:21.760414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:21.761702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:21.762696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 479/943] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:21.767277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:21.841462 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fdba9-687c-45fb-9dc8-c4c0c7332fd6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:21.877920 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344db0c-d99e-46f0-84e4-0a5e9efc8cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:21.879148 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344db0c-d99e-46f0-84e4-0a5e9efc8cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:21.879647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344db0c-d99e-46f0-84e4-0a5e9efc8cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:21.880140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344db0c-d99e-46f0-84e4-0a5e9efc8cc6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:21.881597 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaf4e0-6c56-4310-b968-09ca85862285 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:21.892570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344db0c-d99e-46f0-84e4-0a5e9efc8cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b344db0c-d99e-46f0-84e4-0a5e9efc8cc6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:21.901797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:21.902913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:21.903742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:21.906684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 465/944] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 14:00:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:21.914922 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344db0c-d99e-46f0-84e4-0a5e9efc8cc6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:21.928301 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:21.930521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:21.930814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:21.931095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:21.931863 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:21.932169 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:21.933639 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:21.958889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 480/945] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:22.050303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344db0c-d99e-46f0-84e4-0a5e9efc8cc6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:22.094500 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9357e1-19bd-479c-be12-03ab8ae691cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:22.095193 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9357e1-19bd-479c-be12-03ab8ae691cc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.095477 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9357e1-19bd-479c-be12-03ab8ae691cc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.095752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9357e1-19bd-479c-be12-03ab8ae691cc None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.096535 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9357e1-19bd-479c-be12-03ab8ae691cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:22.096877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9357e1-19bd-479c-be12-03ab8ae691cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:22.098425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9357e1-19bd-479c-be12-03ab8ae691cc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:22.109401 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 466/946] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 14:00:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:22.115252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:22.179799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a73f-032b-4084-9c92-8bc3f36ec3c8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.180230 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a73f-032b-4084-9c92-8bc3f36ec3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.180491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a73f-032b-4084-9c92-8bc3f36ec3c8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.182604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 467/947] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:22.190820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11fafa-07c0-40ed-81f7-adebf38d39e5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.191181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11fafa-07c0-40ed-81f7-adebf38d39e5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.191539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11fafa-07c0-40ed-81f7-adebf38d39e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.214456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-df11fafa-07c0-40ed-81f7-adebf38d39e5 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:22.215841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-df11fafa-07c0-40ed-81f7-adebf38d39e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:22.251325 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5758-3be2-42be-9762-d4e90a744266 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:22.304748 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:22.305934 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.306563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.306910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.308194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 468/948] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:22.330799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11fafa-07c0-40ed-81f7-adebf38d39e5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:22.336693 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:22.339480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:22.361200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:22.362223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:22.363986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:22.363986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:22.363986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:22.363986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:22.363986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 481/949] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:22.369271 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:22.454623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11fafa-07c0-40ed-81f7-adebf38d39e5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:22.497274 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf2243-cf13-4c48-893f-c808b0e28715 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:22.503000 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:22.504141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.504413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.504724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.505426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:22.507792 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:22.524530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:22.526918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:22.528939 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 469/950] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:22.540709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:22.542187 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:22.542860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.543136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.543410 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.544133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:22.544433 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:22.545937 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:22.559037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 482/951] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:22.564023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:22.654154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819713e-cb6d-448b-851b-2d8b6affd833 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:22.698880 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:22.699695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.700077 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.700422 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.701251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:22.701686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:22.701882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539707ee-4ad2-4488-9926-3f8585d1bfdf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:22.703238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:22.712834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 470/952] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:22.721074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:22.748566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:22.749914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.750405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.750890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.759746 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:22.761611 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:22.778115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:22.779122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:22.780058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:22.782820 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 483/953] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:00:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:22.789598 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:22.869582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079235f9-b2d3-471d-98e2-778ffed9d56a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:22.929926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea466fc-0943-494a-aa72-a1c8397bb40c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:22.936568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:22.937936 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.939152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.939635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.941018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:22.941382 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:22.944119 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:22.957191 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 471/954] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:22.981911 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:22.982631 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:22.982915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:22.983194 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:22.984095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:22.984399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:22.985978 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:23.008380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 484/955] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 14:00:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:23.013704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:23.139183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21a14-02c1-478d-be5f-7d46e655acb3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:23.176321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:23.177169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:23.177451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:23.177727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:23.189729 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:23.191271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:23.209923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:23.211672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:23.212567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:23.212567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:23.212567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:23.212567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:23.212567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 472/956] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:23.219118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:23.329997 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf4fb2-ee89-4664-ad66-a7c8cd3b348f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:23.371168 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:23.372528 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:23.373055 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:23.373531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:23.374477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:23.374993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:23.376594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:23.390742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 485/957] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:23.396783 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:23.510591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b50eb-6afa-44e2-8d82-7001c1d458a9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:23.547186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90150a1-0b80-47a5-9d69-7feca6335d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:23.548402 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90150a1-0b80-47a5-9d69-7feca6335d8d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:23.548928 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90150a1-0b80-47a5-9d69-7feca6335d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:23.549406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90150a1-0b80-47a5-9d69-7feca6335d8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:23.557774 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90150a1-0b80-47a5-9d69-7feca6335d8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:23.559570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90150a1-0b80-47a5-9d69-7feca6335d8d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c90150a1-0b80-47a5-9d69-7feca6335d8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:23.575487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:23.576432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:23.577371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:23.577371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:23.577371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:23.577371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:23.577371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:23.577371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:23.577371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:23.577371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:23.579892 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 473/958] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:23.585876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:23.597373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f869eb-f3c1-49f9-ba62-af1016407fe7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:23.598009 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f869eb-f3c1-49f9-ba62-af1016407fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:23.598508 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f869eb-f3c1-49f9-ba62-af1016407fe7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:23.600373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 474/959] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:23.610955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3c199-170f-4d66-b120-16bec134fdcf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:23.611252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3c199-170f-4d66-b120-16bec134fdcf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:23.611498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3c199-170f-4d66-b120-16bec134fdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:23.633686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-97c3c199-170f-4d66-b120-16bec134fdcf None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:23.634900 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-97c3c199-170f-4d66-b120-16bec134fdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:23.708423 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d3543-8aff-4559-948b-ee1fc68c0ab8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:23.732568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 475/960] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:23.759609 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:23.760259 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3c199-170f-4d66-b120-16bec134fdcf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:23.760373 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:23.760584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:23.760959 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:23.761999 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:23.762388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:23.764085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:23.782345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 486/961] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:23.784058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:23.871538 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3c199-170f-4d66-b120-16bec134fdcf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:23.893745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c9f62-52b5-4b77-bb62-64d425696b40 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:23.912017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:23.913952 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:23.914568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:23.915047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:23.915935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:23.917578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:23.930763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38786ad-7cd3-4dd3-95a4-05dd94e34d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:23.931651 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38786ad-7cd3-4dd3-95a4-05dd94e34d43 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:23.931930 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38786ad-7cd3-4dd3-95a4-05dd94e34d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:23.932177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:23.933403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:23.934256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:23.935003 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38786ad-7cd3-4dd3-95a4-05dd94e34d43 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/7616958327124128a02166a27c462312/roles/bb5fe8f8dac0489485dc9f5a8d41d465` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:23.940705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38786ad-7cd3-4dd3-95a4-05dd94e34d43 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=7616958327124128a02166a27c462312, role_id=bb5fe8f8dac0489485dc9f5a8d41d465)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:23.940705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38786ad-7cd3-4dd3-95a4-05dd94e34d43 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:23.948441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 476/962] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:23.949568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:23.966380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 487/963] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:00:23 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/7616958327124128a02166a27c462312/roles/bb5fe8f8dac0489485dc9f5a8d41d465 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:00:24.133404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f58596-bc30-4ead-95d4-438c3097ee49 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:24.196720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:24.196720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:24.196720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:24.196720 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:24.197353 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:24.197353 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:24.197353 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:24.202775 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 477/964] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:24.208489 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38786ad-7cd3-4dd3-95a4-05dd94e34d43 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:24.357139 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38786ad-7cd3-4dd3-95a4-05dd94e34d43 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:24.395684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:24.396368 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:24.396649 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:24.396943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:24.398719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:24.399036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:24.400438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:24.406382 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 488/965] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:24.412316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:24.530386 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660b7aa-8fab-4ad0-8b8e-0920f7f5ac44 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:24.567230 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b410450-1e75-4fbe-beee-bbd8fc033508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:24.567901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410450-1e75-4fbe-beee-bbd8fc033508 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:24.568181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410450-1e75-4fbe-beee-bbd8fc033508 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:24.568454 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410450-1e75-4fbe-beee-bbd8fc033508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:24.569303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b410450-1e75-4fbe-beee-bbd8fc033508 None admin] RBAC: Adding query filter params (interface=admin, service_id=10b4bed4f53746748c805f4ffe8af0cc, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:24.570172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b410450-1e75-4fbe-beee-bbd8fc033508 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:24.571576 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b410450-1e75-4fbe-beee-bbd8fc033508 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:24.577840 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 478/966] 10.222.0.13 () {56 vars in 1249 bytes} [Mon May 16 14:00:24 2022] GET /identity/v3/endpoints?service_id=10b4bed4f53746748c805f4ffe8af0cc&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:24.583365 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:24.637375 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1dff-e32f-402a-b647-eb0cc7d3b581 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:24.637677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1dff-e32f-402a-b647-eb0cc7d3b581 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:24.637844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1dff-e32f-402a-b647-eb0cc7d3b581 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:24.640295 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 479/967] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:24.650452 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7c711-1ac5-494c-acbf-dc23e2ff292b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:24.650779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7c711-1ac5-494c-acbf-dc23e2ff292b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:24.651004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7c711-1ac5-494c-acbf-dc23e2ff292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:24.675545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-03f7c711-1ac5-494c-acbf-dc23e2ff292b None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:24.676769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-03f7c711-1ac5-494c-acbf-dc23e2ff292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:24.713702 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f4f26-4e12-4a4c-a99e-d45a1703e1d8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:24.755192 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 480/968] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:24.781964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730fa6f-cf80-4434-8e8f-933571854802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:24.783072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fa6f-cf80-4434-8e8f-933571854802 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:24.783554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fa6f-cf80-4434-8e8f-933571854802 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:24.784030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fa6f-cf80-4434-8e8f-933571854802 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:24.785352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730fa6f-cf80-4434-8e8f-933571854802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:24.787948 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730fa6f-cf80-4434-8e8f-933571854802 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:24.801383 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7c711-1ac5-494c-acbf-dc23e2ff292b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:24.802458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 489/969] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 14:00:24 2022] GET /identity/v3/services => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:00:25.011791 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7c711-1ac5-494c-acbf-dc23e2ff292b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:25.083014 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:25.084660 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:25.086006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:25.086784 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:25.088411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:25.091377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:25.116717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.sql.core [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 14:00:25.116717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 14:00:25.116717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [parameters: {'user_id': '3385e726832246168faa71cdcd1fef73', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 14:00:25.116717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80057) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() May 16 14:00:25.133833 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:00:25.135479 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application yield resource May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.rollback() May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.force_reraise() May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise self.value May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application session.commit() May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 14:00:25.137285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._prepare_impl() May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.flush() May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._flush(objects) May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application compat.raise_( May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application flush_context.execute() May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rec.execute(self) May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 14:00:25.139943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:00:25.143299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:00:25.150982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [parameters: {'user_id': '3385e726832246168faa71cdcd1fef73', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:25.152712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 14:00:25.155314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 14:00:25.158166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 14:00:25.158166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 14:00:25.158166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 14:00:25.158166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 14:00:25.158166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 14:00:25.158166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:25.158166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 481/970] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 14:00:24 2022] POST /identity/v3/users => generated 160 bytes in 336 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:25.159423 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730fa6f-cf80-4434-8e8f-933571854802 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:25.335910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730fa6f-cf80-4434-8e8f-933571854802 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:25.374308 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0e85b-cf22-4bdd-8a6b-c5ad57dda844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:25.375123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e85b-cf22-4bdd-8a6b-c5ad57dda844 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:25.375408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e85b-cf22-4bdd-8a6b-c5ad57dda844 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:25.375678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e85b-cf22-4bdd-8a6b-c5ad57dda844 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:25.385147 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0e85b-cf22-4bdd-8a6b-c5ad57dda844 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:25.386615 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0e85b-cf22-4bdd-8a6b-c5ad57dda844 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-10a0e85b-cf22-4bdd-8a6b-c5ad57dda844 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:25.403195 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:25.405046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:25.407124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 490/971] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:00:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:25.419950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:25.617820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3f981-c57b-42b0-9f92-3feb2f326d89 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:25.623733 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710d10d-0073-4fb4-9356-de5ed6f94ad3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:25.623733 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710d10d-0073-4fb4-9356-de5ed6f94ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:25.623733 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710d10d-0073-4fb4-9356-de5ed6f94ad3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:25.624916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 491/972] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:25.633670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921368-fb65-4cd7-8f96-236d6b76ce16 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:25.634158 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921368-fb65-4cd7-8f96-236d6b76ce16 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:25.635176 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921368-fb65-4cd7-8f96-236d6b76ce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:25.666499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0e921368-fb65-4cd7-8f96-236d6b76ce16 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:25.668762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e921368-fb65-4cd7-8f96-236d6b76ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:25.685733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:25.687206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:25.687906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:25.688620 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:25.690384 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:25.691128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:25.694438 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:25.781118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 482/973] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 14:00:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:25.805432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 492/974] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:25.845206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:26.000056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6d14b-f123-4f86-9101-900afc921c65 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:26.041422 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0272dcb-4e39-4fb2-96b9-5320f02a4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:26.042142 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0272dcb-4e39-4fb2-96b9-5320f02a4708 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:26.042425 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0272dcb-4e39-4fb2-96b9-5320f02a4708 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:26.042702 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0272dcb-4e39-4fb2-96b9-5320f02a4708 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:26.043488 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0272dcb-4e39-4fb2-96b9-5320f02a4708 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:26.045033 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0272dcb-4e39-4fb2-96b9-5320f02a4708 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:26.063364 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 483/975] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:00:25 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:00:27.371240 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1650e4-73c5-4eb7-80b5-d2fd1240f2a1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:27.371780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1650e4-73c5-4eb7-80b5-d2fd1240f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:27.372311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1650e4-73c5-4eb7-80b5-d2fd1240f2a1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:27.375007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 493/976] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:27.381238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e582e-7e32-429b-85ce-e514f406af49 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:27.381989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e582e-7e32-429b-85ce-e514f406af49 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:27.381989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e582e-7e32-429b-85ce-e514f406af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:27.401881 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-320e582e-7e32-429b-85ce-e514f406af49 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:27.403460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-320e582e-7e32-429b-85ce-e514f406af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:27.491015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 484/977] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:27.515633 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1650e4-73c5-4eb7-80b5-d2fd1240f2a1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:27.590434 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba61e0-8ed1-42e5-a2a4-aff3462668d2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:27.590948 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba61e0-8ed1-42e5-a2a4-aff3462668d2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:27.591447 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba61e0-8ed1-42e5-a2a4-aff3462668d2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:27.594437 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 485/978] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:27.601767 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7784-0e8c-4bab-b1ab-127a1dbac0c2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:27.602102 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7784-0e8c-4bab-b1ab-127a1dbac0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:27.602438 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7784-0e8c-4bab-b1ab-127a1dbac0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:27.624088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1cbc7784-0e8c-4bab-b1ab-127a1dbac0c2 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:27.625225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1cbc7784-0e8c-4bab-b1ab-127a1dbac0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:27.685943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1650e4-73c5-4eb7-80b5-d2fd1240f2a1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:27.721048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 486/979] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:27.749280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:27.750696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:27.751182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:27.751660 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:27.752911 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:27.755511 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:27.765029 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7784-0e8c-4bab-b1ab-127a1dbac0c2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:27.779350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:27.780478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:00:27.781412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:27.787555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 494/980] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 14:00:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:27.789115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:27.933029 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7784-0e8c-4bab-b1ab-127a1dbac0c2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:27.967290 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ff2ae-4470-4b7c-b259-691c02d1c3ce None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:27.989896 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d567d-719a-4a70-9bfc-a9effcfdd4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:27.991274 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d567d-719a-4a70-9bfc-a9effcfdd4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:27.991779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d567d-719a-4a70-9bfc-a9effcfdd4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:27.991980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d567d-719a-4a70-9bfc-a9effcfdd4e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.007789 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d567d-719a-4a70-9bfc-a9effcfdd4e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-883d567d-719a-4a70-9bfc-a9effcfdd4e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:28.017271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:28.019143 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:28.021871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 487/981] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 14:00:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:28.028616 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d567d-719a-4a70-9bfc-a9effcfdd4e9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:28.033813 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:28.035233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.035737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.036231 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.037636 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:28.038185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:28.042237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:28.052242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 495/982] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:28.061390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:28.170902 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d567d-719a-4a70-9bfc-a9effcfdd4e9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:28.212840 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:28.213558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.213847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.214098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.214867 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:28.215173 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:28.216846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:28.227529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 488/983] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 14:00:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:28.237007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:28.239097 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003eb6-0ec6-4b3d-bfd2-2d3f659f7be8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:28.281223 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:28.282157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.282613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.283029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.283890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:28.284336 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:28.286021 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:28.293355 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 496/984] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 14:00:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:28.299495 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:28.424125 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f3cfe-b050-4fca-ade6-02c346c3a938 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:28.432206 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29a012-109b-41eb-b064-a71856949b28 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:28.471857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638ce26-41ae-4b24-b1ff-20bd8104546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:28.472964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638ce26-41ae-4b24-b1ff-20bd8104546d None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.473466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638ce26-41ae-4b24-b1ff-20bd8104546d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.473973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638ce26-41ae-4b24-b1ff-20bd8104546d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.474943 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638ce26-41ae-4b24-b1ff-20bd8104546d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:28.476491 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638ce26-41ae-4b24-b1ff-20bd8104546d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:28.493883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:28.504991 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 497/985] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:00:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:00:28.505433 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.505433 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.505433 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.527200 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:28.530034 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:28.548047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96639587-b1cd-4c11-8a53-6548e24411c7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.548319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96639587-b1cd-4c11-8a53-6548e24411c7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.548604 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96639587-b1cd-4c11-8a53-6548e24411c7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.550037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 498/986] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:28.556913 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b943a1-cc05-4e5a-8f98-181ed44785b2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.557185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b943a1-cc05-4e5a-8f98-181ed44785b2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.557471 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b943a1-cc05-4e5a-8f98-181ed44785b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:28.564480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:28.566518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:28.568947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:28.568947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:28.568947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:28.568947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:28.568947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 489/987] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:28.576561 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d2b943a1-cc05-4e5a-8f98-181ed44785b2 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:28.577924 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d2b943a1-cc05-4e5a-8f98-181ed44785b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:28.578900 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:28.665591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 499/988] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:28.689902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b943a1-cc05-4e5a-8f98-181ed44785b2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:28.704474 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ce4c3-76c0-4449-a307-71bbb737ee6d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:28.743406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:28.744124 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.744444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.744758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.745528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:28.745832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:28.747270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:28.768805 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 490/989] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:28.770417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:28.833337 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b943a1-cc05-4e5a-8f98-181ed44785b2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:28.891092 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:28.892498 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.893038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.893537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.894786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:28.897399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:28.916950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414887b8-5f8a-4e8c-9b59-33567841c616 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:28.926864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:28.929344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:28.931019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:28.939386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 500/990] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:28.945436 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:28.958261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:28.959098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:28.959372 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:28.959643 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:28.968626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:28.970217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:28.987183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:28.989026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:00:28.992520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:28.994372 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 491/991] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:00:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:28.995488 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:29.119915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fae60-44ca-4315-9566-9c19e7188399 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:29.165480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:29.166292 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf4391-83a2-48c1-abae-e050460fdf77 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:29.166490 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:29.166802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:29.167210 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:29.168057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:29.168484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:29.170172 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:29.181319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 501/992] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:29.182812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:29.229463 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:29.230297 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:29.230709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:29.231114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:29.232589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:29.233051 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:29.234634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:29.257110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 492/993] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 14:00:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:29.266282 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:29.321573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb863f3-36cb-4613-9d2e-2e8d3d406df1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:29.363917 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:29.364861 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:29.365314 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:29.365768 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:29.367296 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:29.367900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:29.370238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:29.376748 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 502/994] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:29.384288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:29.453362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c185-ac35-4aa9-b033-6c03a0f4971c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:29.509704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8604-7f44-4908-8b7c-68ad6b4540d6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:29.521388 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aca2da-1a02-4dd2-869a-bf28359a7275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:29.523568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca2da-1a02-4dd2-869a-bf28359a7275 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:29.524082 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca2da-1a02-4dd2-869a-bf28359a7275 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:29.524579 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca2da-1a02-4dd2-869a-bf28359a7275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:29.551762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:29.552621 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:29.553129 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:29.553564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:29.555028 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] RBAC: Adding query filter params (interface=public, service_id=5dd564d3c67f4b6abcfaf9e53251a230, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:29.555469 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:29.557325 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:29.563750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 503/995] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 14:00:29 2022] GET /identity/v3/endpoints?service_id=5dd564d3c67f4b6abcfaf9e53251a230&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:29.570326 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:29.650292 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aca2da-1a02-4dd2-869a-bf28359a7275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:29.651780 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aca2da-1a02-4dd2-869a-bf28359a7275 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:29.688296 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd859-7ae9-4700-a7c4-cdd5d99acd83 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:29.725744 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5c005-354d-44ed-86de-7e02de0ccf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:29.727630 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c005-354d-44ed-86de-7e02de0ccf80 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:29.727822 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c005-354d-44ed-86de-7e02de0ccf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:29.727958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c005-354d-44ed-86de-7e02de0ccf80 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:29.728949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5c005-354d-44ed-86de-7e02de0ccf80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:29.730346 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5c005-354d-44ed-86de-7e02de0ccf80 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:29.737468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 504/996] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 14:00:29 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 14:00:29.763518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 493/997] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:29 2022] GET /identity/v3/auth/tokens => generated 1707 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 14:00:29.769255 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5c005-354d-44ed-86de-7e02de0ccf80 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:29.935072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5c005-354d-44ed-86de-7e02de0ccf80 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:29.980399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:29.981246 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:29.981538 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:29.981814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:29.994967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:29.996457 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:30.015362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:30.016711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:30.017676 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:30.017676 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:30.017676 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:30.017676 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:30.017676 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 505/998] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:30.022161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aca2da-1a02-4dd2-869a-bf28359a7275 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:30.129257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aca2da-1a02-4dd2-869a-bf28359a7275 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:30.182899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:30.183576 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:30.183853 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:30.184121 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:30.184879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:30.185180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:30.186539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:30.206694 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 494/999] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:30.208421 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:30.359925 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546011-f6ae-4412-8b58-8e78e22a9f26 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:30.396053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:30.396891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:30.397180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:30.397460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:30.405395 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:30.406871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:30.421807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:30.422824 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:30.423919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:30.423919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:30.423919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:30.423919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:30.423919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:30.423919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:30.423919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:30.423919 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:30.425424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 506/1000] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:30.429027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:30.544790 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a34828-39f6-46e0-b710-dad308efe5e4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:30.582100 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595b7a-4919-44f8-9846-44e08c015eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:30.582773 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595b7a-4919-44f8-9846-44e08c015eae None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:30.583052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595b7a-4919-44f8-9846-44e08c015eae None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:30.583327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595b7a-4919-44f8-9846-44e08c015eae None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:30.584139 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595b7a-4919-44f8-9846-44e08c015eae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:30.584445 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595b7a-4919-44f8-9846-44e08c015eae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:30.586606 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595b7a-4919-44f8-9846-44e08c015eae None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:30.600129 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 495/1001] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:30.607463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:30.723507 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a498-c1e1-41b8-8a4a-f2c7bc19122d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:30.761839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc42c-3b68-4753-a2d5-01e4344f797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:30.762508 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc42c-3b68-4753-a2d5-01e4344f797a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:30.762785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc42c-3b68-4753-a2d5-01e4344f797a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:30.763063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc42c-3b68-4753-a2d5-01e4344f797a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:30.763983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc42c-3b68-4753-a2d5-01e4344f797a None admin] RBAC: Adding query filter params (role.id=bb5fe8f8dac0489485dc9f5a8d41d465, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=7616958327124128a02166a27c462312) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:30.764286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc42c-3b68-4753-a2d5-01e4344f797a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:30.765778 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc42c-3b68-4753-a2d5-01e4344f797a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:30.772319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 507/1002] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:30 2022] GET /identity/v3/role_assignments?user.id=7616958327124128a02166a27c462312&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=bb5fe8f8dac0489485dc9f5a8d41d465 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:31.058751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b376e-15e4-4140-80ea-cb4dc55a5f52 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:31.059153 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b376e-15e4-4140-80ea-cb4dc55a5f52 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:31.059332 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b376e-15e4-4140-80ea-cb4dc55a5f52 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:31.060878 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 496/1003] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:31.066238 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0bc69-747c-4b0d-b76e-4ddc4ee27389 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:31.066522 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0bc69-747c-4b0d-b76e-4ddc4ee27389 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:31.066800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0bc69-747c-4b0d-b76e-4ddc4ee27389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:31.087547 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-31e0bc69-747c-4b0d-b76e-4ddc4ee27389 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:31.089121 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-31e0bc69-747c-4b0d-b76e-4ddc4ee27389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:31.166607 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 508/1004] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:31.189469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b376e-15e4-4140-80ea-cb4dc55a5f52 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:31.298782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b376e-15e4-4140-80ea-cb4dc55a5f52 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:31.337424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04415e48-30f7-4a71-9ae6-b393f81091ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:31.338785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415e48-30f7-4a71-9ae6-b393f81091ca None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:31.339069 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415e48-30f7-4a71-9ae6-b393f81091ca None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:31.339346 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415e48-30f7-4a71-9ae6-b393f81091ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:31.340787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04415e48-30f7-4a71-9ae6-b393f81091ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:31.342315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04415e48-30f7-4a71-9ae6-b393f81091ca None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:31.344423 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 497/1005] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:31.350556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0bc69-747c-4b0d-b76e-4ddc4ee27389 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:31.473870 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0bc69-747c-4b0d-b76e-4ddc4ee27389 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:31.530065 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e8359-23bc-4051-8400-940658ee88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:31.531165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e8359-23bc-4051-8400-940658ee88aa None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:31.531661 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e8359-23bc-4051-8400-940658ee88aa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:31.531967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e8359-23bc-4051-8400-940658ee88aa None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:31.533242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e8359-23bc-4051-8400-940658ee88aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:31.535957 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e8359-23bc-4051-8400-940658ee88aa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:31.573391 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 509/1006] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:00:31 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:00:32.170393 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e8897-c5f8-4d8b-9b1c-e4a793b3136f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:32.170918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e8897-c5f8-4d8b-9b1c-e4a793b3136f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:32.170918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e8897-c5f8-4d8b-9b1c-e4a793b3136f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:32.172440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 498/1007] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:32.178553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442021b1-a0ac-49a2-8bbf-ea33be3f3d10 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:32.179109 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442021b1-a0ac-49a2-8bbf-ea33be3f3d10 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:32.179199 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442021b1-a0ac-49a2-8bbf-ea33be3f3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:32.201219 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-442021b1-a0ac-49a2-8bbf-ea33be3f3d10 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:32.202425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-442021b1-a0ac-49a2-8bbf-ea33be3f3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:32.298395 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 510/1008] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:32.322619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e8897-c5f8-4d8b-9b1c-e4a793b3136f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:32.436486 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e8897-c5f8-4d8b-9b1c-e4a793b3136f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:32.473839 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:32.474645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:32.474927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:32.475187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:32.475841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:32.477809 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:32.490772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:32.492730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:00:32.494961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:32.502609 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 499/1009] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:32.502720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442021b1-a0ac-49a2-8bbf-ea33be3f3d10 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:32.666405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442021b1-a0ac-49a2-8bbf-ea33be3f3d10 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:32.728007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:32.729375 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:32.729872 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:32.730356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:32.731664 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:32.732217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:32.734699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:32.750750 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 511/1010] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:32.752259 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:32.864263 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1515-45d7-459f-8798-85a3b5703eb8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:32.905826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be450a01-2dae-4688-82a2-865963107fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:32.907210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be450a01-2dae-4688-82a2-865963107fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:32.907638 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be450a01-2dae-4688-82a2-865963107fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:32.908066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be450a01-2dae-4688-82a2-865963107fd1 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:32.908982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be450a01-2dae-4688-82a2-865963107fd1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:32.909426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be450a01-2dae-4688-82a2-865963107fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:32.910989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be450a01-2dae-4688-82a2-865963107fd1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:32.922739 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 500/1011] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 14:00:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:32.924065 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:33.043840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23b493-b5f8-4e06-8bf2-c68230286983 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:33.084311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881adff1-d8a6-4fa1-9c11-d35a091968ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:33.085013 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881adff1-d8a6-4fa1-9c11-d35a091968ef None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:33.085293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881adff1-d8a6-4fa1-9c11-d35a091968ef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:33.085567 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881adff1-d8a6-4fa1-9c11-d35a091968ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:33.086847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881adff1-d8a6-4fa1-9c11-d35a091968ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:33.088235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881adff1-d8a6-4fa1-9c11-d35a091968ef None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:33.110342 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 512/1012] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:00:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:00:33.238825 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5948e-c1cb-49ed-909c-9a804f1c1458 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:33.239542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5948e-c1cb-49ed-909c-9a804f1c1458 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:33.239542 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5948e-c1cb-49ed-909c-9a804f1c1458 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:33.241237 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 501/1013] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:33.250621 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054bdd7-ecdd-4e8f-ae4a-d23517f352a6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:33.251162 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054bdd7-ecdd-4e8f-ae4a-d23517f352a6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:33.251593 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054bdd7-ecdd-4e8f-ae4a-d23517f352a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:33.282464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4054bdd7-ecdd-4e8f-ae4a-d23517f352a6 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:33.284594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4054bdd7-ecdd-4e8f-ae4a-d23517f352a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:33.405541 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 513/1014] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:33 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:33.429124 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5948e-c1cb-49ed-909c-9a804f1c1458 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:33.612340 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5948e-c1cb-49ed-909c-9a804f1c1458 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:33.673313 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:33.675217 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:33.676025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:33.676831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:33.678354 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:33.681280 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:33.704721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:33.706561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:33.708131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:33.709653 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 502/1015] 10.222.0.13 () {56 vars in 1105 bytes} [Mon May 16 14:00:33 2022] GET /identity/v3/services/image => generated 86 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:33.717063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054bdd7-ecdd-4e8f-ae4a-d23517f352a6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:33.833501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054bdd7-ecdd-4e8f-ae4a-d23517f352a6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:33.896799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d94067-10ca-4729-96d8-36a1affe7673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:33.897968 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94067-10ca-4729-96d8-36a1affe7673 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:33.899000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94067-10ca-4729-96d8-36a1affe7673 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:33.899502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94067-10ca-4729-96d8-36a1affe7673 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:33.900908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d94067-10ca-4729-96d8-36a1affe7673 None admin] RBAC: Adding query filter params (name=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:33.901399 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d94067-10ca-4729-96d8-36a1affe7673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:33.903512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d94067-10ca-4729-96d8-36a1affe7673 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:33.917109 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 514/1016] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:33.918453 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:34.046664 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae8075-6d6a-42f1-949e-5acb93b230c2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:34.107625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd676b-39b3-4e8e-8091-e7c386d3c540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:34.108849 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd676b-39b3-4e8e-8091-e7c386d3c540 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:34.109355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd676b-39b3-4e8e-8091-e7c386d3c540 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:34.109800 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd676b-39b3-4e8e-8091-e7c386d3c540 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:34.111094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd676b-39b3-4e8e-8091-e7c386d3c540 None admin] RBAC: Adding query filter params (type=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:34.111722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd676b-39b3-4e8e-8091-e7c386d3c540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:34.114480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd676b-39b3-4e8e-8091-e7c386d3c540 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:34.128822 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 503/1017] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:34.793457 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2a93-8dea-4c7a-bc2b-2fee0b0508cc None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:34.794257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2a93-8dea-4c7a-bc2b-2fee0b0508cc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:34.794257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2a93-8dea-4c7a-bc2b-2fee0b0508cc None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:34.795804 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 515/1018] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:34.801787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d988-0f24-40bc-8c1d-33b5d053af91 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:34.802499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d988-0f24-40bc-8c1d-33b5d053af91 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:34.802499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d988-0f24-40bc-8c1d-33b5d053af91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:34.820571 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7c53d988-0f24-40bc-8c1d-33b5d053af91 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:34.821825 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7c53d988-0f24-40bc-8c1d-33b5d053af91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:34.913485 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 504/1019] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:34.954320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c2a93-8dea-4c7a-bc2b-2fee0b0508cc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:35.098235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c2a93-8dea-4c7a-bc2b-2fee0b0508cc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:35.136313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83ee0d-278b-4937-990f-89085ae67156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:35.137155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83ee0d-278b-4937-990f-89085ae67156 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:35.137441 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83ee0d-278b-4937-990f-89085ae67156 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:35.137698 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83ee0d-278b-4937-990f-89085ae67156 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:35.138904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83ee0d-278b-4937-990f-89085ae67156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:35.140333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83ee0d-278b-4937-990f-89085ae67156 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:35.142289 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 516/1020] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:35.148946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d988-0f24-40bc-8c1d-33b5d053af91 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:35.264301 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d988-0f24-40bc-8c1d-33b5d053af91 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:35.303620 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45a0e5-56ac-4ab5-ac94-45008b108980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:35.304300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45a0e5-56ac-4ab5-ac94-45008b108980 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:35.308243 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45a0e5-56ac-4ab5-ac94-45008b108980 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:35.308243 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45a0e5-56ac-4ab5-ac94-45008b108980 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:35.308243 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45a0e5-56ac-4ab5-ac94-45008b108980 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:35.308243 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45a0e5-56ac-4ab5-ac94-45008b108980 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:35.348822 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 505/1021] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 14:00:35 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:00:35.970711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d996a-1405-42a0-a123-184ed2d1134a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:35.971230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d996a-1405-42a0-a123-184ed2d1134a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:35.971230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d996a-1405-42a0-a123-184ed2d1134a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:35.972786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 517/1022] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:35.978797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6da69-da16-4259-b8e1-e77533ef4d90 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:35.979544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6da69-da16-4259-b8e1-e77533ef4d90 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:35.979623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6da69-da16-4259-b8e1-e77533ef4d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:35.996851 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-70f6da69-da16-4259-b8e1-e77533ef4d90 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:35.998073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-70f6da69-da16-4259-b8e1-e77533ef4d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:36.094882 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 506/1023] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:36.121129 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d996a-1405-42a0-a123-184ed2d1134a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:36.256796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d996a-1405-42a0-a123-184ed2d1134a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:36.316322 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126955f0-e4cc-4c4b-9135-9b6657c7011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:36.317739 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126955f0-e4cc-4c4b-9135-9b6657c7011b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:36.318230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126955f0-e4cc-4c4b-9135-9b6657c7011b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:36.318710 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126955f0-e4cc-4c4b-9135-9b6657c7011b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:36.338211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126955f0-e4cc-4c4b-9135-9b6657c7011b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-126955f0-e4cc-4c4b-9135-9b6657c7011b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:36.355044 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:36.356081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:36.356942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:36.358244 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 518/1024] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 14:00:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:36.364709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6da69-da16-4259-b8e1-e77533ef4d90 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:36.543946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6da69-da16-4259-b8e1-e77533ef4d90 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:36.603594 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c776-6f69-4278-8939-5180a9a582a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:36.605026 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c776-6f69-4278-8939-5180a9a582a8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:36.605498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c776-6f69-4278-8939-5180a9a582a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:36.605991 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c776-6f69-4278-8939-5180a9a582a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:36.607403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5c776-6f69-4278-8939-5180a9a582a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:36.607943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5c776-6f69-4278-8939-5180a9a582a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:36.610441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5c776-6f69-4278-8939-5180a9a582a8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:36.633314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 507/1025] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 14:00:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:36.636413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126955f0-e4cc-4c4b-9135-9b6657c7011b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:36.775966 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c3a14-0da3-468a-8335-47ea544cb83e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:36.776416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c3a14-0da3-468a-8335-47ea544cb83e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:36.776869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c3a14-0da3-468a-8335-47ea544cb83e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:36.778596 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 508/1026] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:36.784620 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156945a-c7e9-4982-bc6a-7b1b46e70dac None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:36.785114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156945a-c7e9-4982-bc6a-7b1b46e70dac None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:36.785541 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156945a-c7e9-4982-bc6a-7b1b46e70dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:36.805965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9156945a-c7e9-4982-bc6a-7b1b46e70dac None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:36.807413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9156945a-c7e9-4982-bc6a-7b1b46e70dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:36.834077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126955f0-e4cc-4c4b-9135-9b6657c7011b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:36.879901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:36.881136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:36.881640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:36.882126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:36.895591 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:36.898557 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:36.914662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 509/1027] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:36 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:36.924051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:36.933797 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:36.935883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:36.935883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:36.935883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:36.935883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:36.935883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 519/1028] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:36.942067 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156945a-c7e9-4982-bc6a-7b1b46e70dac None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:36.952179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:37.087799 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156945a-c7e9-4982-bc6a-7b1b46e70dac None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:37.120545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22e79-453f-4c5a-b381-560e46758b87 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:37.136370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:37.137549 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:37.138272 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:37.138527 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:37.139901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:37.140456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:37.142938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:37.163777 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 510/1029] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:37.173366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:37.174570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a54b3c-5aeb-4a43-ad48-54065c2ba79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:37.175251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a54b3c-5aeb-4a43-ad48-54065c2ba79d None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:37.175592 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a54b3c-5aeb-4a43-ad48-54065c2ba79d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:37.175872 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a54b3c-5aeb-4a43-ad48-54065c2ba79d None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:37.176620 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a54b3c-5aeb-4a43-ad48-54065c2ba79d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:37.178070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a54b3c-5aeb-4a43-ad48-54065c2ba79d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:37.194083 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 520/1030] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:00:36 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:00:37.382261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9196-4e90-4f4f-bc52-8d9989c220bc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:37.450066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:37.451352 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:37.451819 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:37.452301 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:37.463896 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:37.465438 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:37.491949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:37.493824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:00:37.494997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:37.496141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 511/1031] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 14:00:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:37.505369 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a54b3c-5aeb-4a43-ad48-54065c2ba79d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:37.671562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a54b3c-5aeb-4a43-ad48-54065c2ba79d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:37.722678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:37.723889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:37.724373 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:37.724779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:37.726243 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:37.726584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:37.728058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:37.748745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 521/1032] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 14:00:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:37.754741 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:37.906210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67bad-dccd-4aa0-add0-9370c9ff18dd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:37.965334 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb75272-1fee-4f6b-80e3-f2ce94ee5697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:37.966449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb75272-1fee-4f6b-80e3-f2ce94ee5697 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:37.966952 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb75272-1fee-4f6b-80e3-f2ce94ee5697 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:37.967445 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb75272-1fee-4f6b-80e3-f2ce94ee5697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:38.066797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb75272-1fee-4f6b-80e3-f2ce94ee5697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:38.068256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb75272-1fee-4f6b-80e3-f2ce94ee5697 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:38.172883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 512/1033] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:00:38.175018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:38.217280 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382d6c-f4dd-4076-b86a-29dec2aaf3a9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:38.217487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382d6c-f4dd-4076-b86a-29dec2aaf3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:38.217768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382d6c-f4dd-4076-b86a-29dec2aaf3a9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:38.219145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 513/1034] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:38.224478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2032-59ba-4756-a1ab-3bcf1e184fc4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:38.224876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2032-59ba-4756-a1ab-3bcf1e184fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:38.225075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2032-59ba-4756-a1ab-3bcf1e184fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:38.243357 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-241a2032-59ba-4756-a1ab-3bcf1e184fc4 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:38.244663 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-241a2032-59ba-4756-a1ab-3bcf1e184fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:38.301019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f25f5-e0fc-4689-b663-4585b8fb7e71 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:38.326987 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 514/1035] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:38.344626 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:38.345918 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:38.346405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:38.346892 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:38.353495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2032-59ba-4756-a1ab-3bcf1e184fc4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:38.361335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:38.362813 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:38.384742 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:38.386230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:38.387394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:38.387394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:38.387394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:38.387394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:38.387394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 522/1036] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:38.391710 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:38.483888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2032-59ba-4756-a1ab-3bcf1e184fc4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:38.511464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03ab7a-403f-44ec-8635-ffb3a2d63bab None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:38.526819 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86ec66-398d-42a8-b720-32f22e8c85fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:38.527744 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ec66-398d-42a8-b720-32f22e8c85fb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:38.528025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ec66-398d-42a8-b720-32f22e8c85fb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:38.528396 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ec66-398d-42a8-b720-32f22e8c85fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:38.542824 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86ec66-398d-42a8-b720-32f22e8c85fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:38.549482 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:38.550161 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:38.550443 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9a86ec66-398d-42a8-b720-32f22e8c85fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:38.550602 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:38.551504 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:38.552339 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:38.553047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:38.553047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:38.553047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:38.553236 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 515/1037] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:38.558895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86ec66-398d-42a8-b720-32f22e8c85fb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:38.559346 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:38.581076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 523/1038] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:38.582034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:38.707110 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66779cd-270b-49c1-8c1a-c17fef9ac427 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:38.707431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86ec66-398d-42a8-b720-32f22e8c85fb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:38.756181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:38.757064 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:38.757349 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:38.758047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:38.764708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40455e08-edb7-4715-9736-047695051450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:38.765978 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40455e08-edb7-4715-9736-047695051450 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:38.766312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40455e08-edb7-4715-9736-047695051450 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:38.766672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40455e08-edb7-4715-9736-047695051450 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:38.767998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40455e08-edb7-4715-9736-047695051450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:38.768185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:38.768352 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40455e08-edb7-4715-9736-047695051450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:38.769665 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:38.770907 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40455e08-edb7-4715-9736-047695051450 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:38.785877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:38.787068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:38.788076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:38.788076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:38.788076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:38.788076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:38.788076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:38.788076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:38.788076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:38.788076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:38.788802 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 516/1039] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:38.793484 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 524/1040] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:38.794141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40455e08-edb7-4715-9736-047695051450 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:38.799341 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:38.937080 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40455e08-edb7-4715-9736-047695051450 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:38.960651 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127b7f-f1e8-4079-95f0-47216427d024 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:38.998025 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a442a7-ca11-4889-a812-ad2f129722a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:38.999567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a442a7-ca11-4889-a812-ad2f129722a6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.000053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a442a7-ca11-4889-a812-ad2f129722a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.000544 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a442a7-ca11-4889-a812-ad2f129722a6 None admin] PATH_INFO: `/v3/users/386efa9f495a47ebbf89e86fe5fec1d8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.002060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:39.002748 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.003029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.003304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.004119 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:39.004422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:39.005973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:39.019725 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 525/1041] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:39.026149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:39.028432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a442a7-ca11-4889-a812-ad2f129722a6 None admin] RBAC: Authorizing `identity:get_user(user_id=386efa9f495a47ebbf89e86fe5fec1d8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:39.031056 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a442a7-ca11-4889-a812-ad2f129722a6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:39.032043 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 517/1042] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:00:38 2022] GET /identity/v3/users/386efa9f495a47ebbf89e86fe5fec1d8 => generated 285 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:39.037735 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a442a7-ca11-4889-a812-ad2f129722a6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:39.168134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a442a7-ca11-4889-a812-ad2f129722a6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:39.169856 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662c2e8-08c7-4083-8ef1-e9bac17c82e7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:39.207768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9a57e-c3c1-451f-a960-2ed07bc93b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:39.208588 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a57e-c3c1-451f-a960-2ed07bc93b6e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.208911 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a57e-c3c1-451f-a960-2ed07bc93b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.209195 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a57e-c3c1-451f-a960-2ed07bc93b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.232323 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:39.233512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.234017 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.234503 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.236182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] RBAC: Adding query filter params (role.id=bb5fe8f8dac0489485dc9f5a8d41d465, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=c40d0702d56d47b48afc200b4de3027f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:39.236791 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:39.239610 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:39.249983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 526/1043] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:39 2022] GET /identity/v3/role_assignments?user.id=c40d0702d56d47b48afc200b4de3027f&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=bb5fe8f8dac0489485dc9f5a8d41d465 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:39.295306 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9a57e-c3c1-451f-a960-2ed07bc93b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:39.296707 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9a57e-c3c1-451f-a960-2ed07bc93b6e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:39.425624 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 518/1044] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 14:00:39.433788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:39.636287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425024c-2c68-4a60-8fcf-6fbe7851882e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:39.653876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4fd4-b0d3-4a03-b8db-6303f9e3f429 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.654215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4fd4-b0d3-4a03-b8db-6303f9e3f429 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.654447 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4fd4-b0d3-4a03-b8db-6303f9e3f429 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.656102 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 519/1045] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:39.661811 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f541260-b358-447a-b82d-62b55e5c83c8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.662107 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f541260-b358-447a-b82d-62b55e5c83c8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.662379 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f541260-b358-447a-b82d-62b55e5c83c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.681111 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9f541260-b358-447a-b82d-62b55e5c83c8 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:39.682111 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9f541260-b358-447a-b82d-62b55e5c83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:39.701386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6df94-8daf-427d-853a-aef790a77869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:39.702698 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6df94-8daf-427d-853a-aef790a77869 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.703203 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6df94-8daf-427d-853a-aef790a77869 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.703694 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6df94-8daf-427d-853a-aef790a77869 None admin] PATH_INFO: `/v3/projects/5f1cb7829b45472baebcc188399c4e98` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.705931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6df94-8daf-427d-853a-aef790a77869 None admin] RBAC: Authorizing `identity:get_project(project_id=5f1cb7829b45472baebcc188399c4e98)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:39.708493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6df94-8daf-427d-853a-aef790a77869 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:39.713083 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 527/1046] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:00:39 2022] GET /identity/v3/projects/5f1cb7829b45472baebcc188399c4e98 => generated 311 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:39.720202 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6df94-8daf-427d-853a-aef790a77869 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:39.787584 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 520/1047] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:39.828155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f541260-b358-447a-b82d-62b55e5c83c8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:39.853666 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6df94-8daf-427d-853a-aef790a77869 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:39.903251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:39.903251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.903251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.903251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.903647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=5f1cb7829b45472baebcc188399c4e98, user.id=386efa9f495a47ebbf89e86fe5fec1d8) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:39.903647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:39.903960 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:39.913027 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 528/1048] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:39 2022] GET /identity/v3/role_assignments?user.id=386efa9f495a47ebbf89e86fe5fec1d8&scope.project.id=5f1cb7829b45472baebcc188399c4e98&role.id=52bf3a299728408b8384e30e08547fd8 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:39.954246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f541260-b358-447a-b82d-62b55e5c83c8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:39.996947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:39.997771 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:39.998048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:39.998329 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] PATH_INFO: `/v3/services/image` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:39.998992 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:40.000387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:40.013905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:40.015903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:40.017567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 521/1049] 10.222.0.13 () {56 vars in 1105 bytes} [Mon May 16 14:00:39 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:40.025387 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:40.220572 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20f14-2fdc-4f22-8fb9-f5aed96fa889 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:40.285270 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:40.286477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:40.286881 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:40.287366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:40.288630 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] RBAC: Adding query filter params (name=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:40.289859 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:40.292143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:40.307465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 529/1050] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:40.309156 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:40.495686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c6952-255d-434a-b597-5d39811dea0e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:40.561527 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:40.562710 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:40.563204 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:40.563673 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:40.565098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:40.565643 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:40.568228 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:40.584712 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 522/1051] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:40.589832 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:40.779318 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1c5c0-1d4b-471a-b43d-e8240a4a2d4c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:40.825091 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf7b4-2f1e-4834-bbc1-c3ad44d2b1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:40.825759 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf7b4-2f1e-4834-bbc1-c3ad44d2b1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:40.826039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf7b4-2f1e-4834-bbc1-c3ad44d2b1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:40.826308 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf7b4-2f1e-4834-bbc1-c3ad44d2b1f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:40.827112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf7b4-2f1e-4834-bbc1-c3ad44d2b1f1 None admin] RBAC: Adding query filter params (interface=public, service_id=602fdb8ad0df41e9ad6db838a0bb29b1, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:40.827415 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf7b4-2f1e-4834-bbc1-c3ad44d2b1f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:40.828825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf7b4-2f1e-4834-bbc1-c3ad44d2b1f1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:40.835048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 530/1052] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 14:00:40 2022] GET /identity/v3/endpoints?service_id=602fdb8ad0df41e9ad6db838a0bb29b1&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:40.841753 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:41.003714 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebca87-8305-494f-878f-d1051dbb24d7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:41.051536 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bdf87-79f7-4cbf-b184-6ff93b07124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:41.052501 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bdf87-79f7-4cbf-b184-6ff93b07124f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:41.053228 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bdf87-79f7-4cbf-b184-6ff93b07124f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:41.053697 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bdf87-79f7-4cbf-b184-6ff93b07124f None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:41.054930 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bdf87-79f7-4cbf-b184-6ff93b07124f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:41.057993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bdf87-79f7-4cbf-b184-6ff93b07124f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:41.076722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 523/1053] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 14:00:40 2022] GET /identity/v3/services => generated 1957 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 14:00:41.980381 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cdc0-cbe3-48e6-9157-70f8ca5c9f49 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:41.981205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cdc0-cbe3-48e6-9157-70f8ca5c9f49 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:41.981205 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cdc0-cbe3-48e6-9157-70f8ca5c9f49 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:41.982529 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 531/1054] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:41.988122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d314aca-4336-4662-9546-a8d38f2f0bc1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:41.988625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d314aca-4336-4662-9546-a8d38f2f0bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:41.988734 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d314aca-4336-4662-9546-a8d38f2f0bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.005610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9d314aca-4336-4662-9546-a8d38f2f0bc1 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:42.006810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9d314aca-4336-4662-9546-a8d38f2f0bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:42.091815 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 524/1055] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:42.114786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3cdc0-cbe3-48e6-9157-70f8ca5c9f49 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:42.238876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3cdc0-cbe3-48e6-9157-70f8ca5c9f49 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:42.262947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f324-5eba-4c81-aff7-501daef7da12 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.263436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f324-5eba-4c81-aff7-501daef7da12 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.263921 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f324-5eba-4c81-aff7-501daef7da12 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.266159 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 525/1056] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:42.271600 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa943df-39ce-4c62-9b74-b1991f4a7020 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.271886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa943df-39ce-4c62-9b74-b1991f4a7020 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.272150 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa943df-39ce-4c62-9b74-b1991f4a7020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.278023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eaf8c-1384-4849-a6b8-a7ae6e3fde43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:42.278833 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eaf8c-1384-4849-a6b8-a7ae6e3fde43 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.279106 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eaf8c-1384-4849-a6b8-a7ae6e3fde43 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.279372 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eaf8c-1384-4849-a6b8-a7ae6e3fde43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.291942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783eaf8c-1384-4849-a6b8-a7ae6e3fde43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:42.297539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4fa943df-39ce-4c62-9b74-b1991f4a7020 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:42.298741 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4fa943df-39ce-4c62-9b74-b1991f4a7020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-783eaf8c-1384-4849-a6b8-a7ae6e3fde43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:42.300422 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:42.302250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:42.304041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 532/1057] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 14:00:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:42.308073 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eaf8c-1384-4849-a6b8-a7ae6e3fde43 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:42.385406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 526/1058] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:42.403395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa943df-39ce-4c62-9b74-b1991f4a7020 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:42.436350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eaf8c-1384-4849-a6b8-a7ae6e3fde43 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:42.488572 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:42.489387 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.489579 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.489846 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.490611 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:42.490915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:42.492313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:42.501582 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 533/1059] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 14:00:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:42.507686 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:42.536173 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa943df-39ce-4c62-9b74-b1991f4a7020 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:42.575394 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab4b7e-0ac1-4c70-805b-02128d30cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:42.576057 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4b7e-0ac1-4c70-805b-02128d30cd29 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.576342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4b7e-0ac1-4c70-805b-02128d30cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.576613 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4b7e-0ac1-4c70-805b-02128d30cd29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.590508 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab4b7e-0ac1-4c70-805b-02128d30cd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a0ab4b7e-0ac1-4c70-805b-02128d30cd29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:42.604622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:42.605923 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:42.613481 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 527/1060] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:42.616067 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab4b7e-0ac1-4c70-805b-02128d30cd29 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:42.632124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939bcb8-9282-4602-84f3-2dd3239b9401 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:42.673722 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:42.674517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.674793 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.675058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.686780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:42.688289 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:42.706118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:42.707366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:42.708588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:42.708588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:42.708588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:42.708588 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:42.712638 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 534/1061] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:42.713830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:42.738120 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab4b7e-0ac1-4c70-805b-02128d30cd29 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:42.780616 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:42.781721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.782153 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.782587 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.783834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:42.784328 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:42.786679 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:42.806084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 528/1062] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:42.810978 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:42.827019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddacaa-fa56-4e4f-8b6f-55f3d958f7c6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:42.879936 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:42.881116 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.881589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.882047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:42.884015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:42.884566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:42.887033 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:42.920634 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 535/1063] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:42.921857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:42.957827 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d51c8d-2446-44b7-9fe3-1c75f1f99e48 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:42.997854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8600-36bc-4c46-bb50-7511a6437613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:42.998782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8600-36bc-4c46-bb50-7511a6437613 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:42.999023 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8600-36bc-4c46-bb50-7511a6437613 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:42.999299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8600-36bc-4c46-bb50-7511a6437613 None admin] PATH_INFO: `/v3/users/386efa9f495a47ebbf89e86fe5fec1d8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.000635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8600-36bc-4c46-bb50-7511a6437613 None admin] RBAC: Authorizing `identity:get_user(user_id=386efa9f495a47ebbf89e86fe5fec1d8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:43.002126 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8600-36bc-4c46-bb50-7511a6437613 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:43.004124 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 529/1064] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:00:42 2022] GET /identity/v3/users/386efa9f495a47ebbf89e86fe5fec1d8 => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:43.010142 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8600-36bc-4c46-bb50-7511a6437613 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:43.061936 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb1a07-fcf1-4093-8e22-7f5f356fb560 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:43.099248 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:43.100104 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:43.100402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:43.100654 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.109279 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:43.110772 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:43.127829 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:43.129011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:00:43.130477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:43.133056 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 536/1065] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 14:00:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:43.135281 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:43.162472 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8600-36bc-4c46-bb50-7511a6437613 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:43.201997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1397c99-e4ce-47a8-8c68-292b517c609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:43.202877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397c99-e4ce-47a8-8c68-292b517c609a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:43.203159 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397c99-e4ce-47a8-8c68-292b517c609a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:43.203437 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397c99-e4ce-47a8-8c68-292b517c609a None admin] PATH_INFO: `/v3/projects/5f1cb7829b45472baebcc188399c4e98` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.204708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1397c99-e4ce-47a8-8c68-292b517c609a None admin] RBAC: Authorizing `identity:get_project(project_id=5f1cb7829b45472baebcc188399c4e98)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:43.206167 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1397c99-e4ce-47a8-8c68-292b517c609a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:43.208127 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 530/1066] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:00:43 2022] GET /identity/v3/projects/5f1cb7829b45472baebcc188399c4e98 => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:43.216405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1397c99-e4ce-47a8-8c68-292b517c609a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:43.260357 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f51a2-2a9a-4292-b842-5d3eb2015f6e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:43.305353 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:43.306511 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:43.306961 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:43.307412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.308896 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:43.309390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:43.311897 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:43.338253 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 537/1067] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 14:00:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:43.343876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:43.381709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1397c99-e4ce-47a8-8c68-292b517c609a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:43.431307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc762-e880-4525-98fd-6c239afcd664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:43.433652 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc762-e880-4525-98fd-6c239afcd664 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:43.434152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc762-e880-4525-98fd-6c239afcd664 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:43.434575 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc762-e880-4525-98fd-6c239afcd664 None admin] PATH_INFO: `/v3/projects/5f1cb7829b45472baebcc188399c4e98/users/386efa9f495a47ebbf89e86fe5fec1d8/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.437871 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dc762-e880-4525-98fd-6c239afcd664 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f1cb7829b45472baebcc188399c4e98, user_id=386efa9f495a47ebbf89e86fe5fec1d8, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:43.440266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dc762-e880-4525-98fd-6c239afcd664 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:43.464273 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 531/1068] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:00:43 2022] PUT /identity/v3/projects/5f1cb7829b45472baebcc188399c4e98/users/386efa9f495a47ebbf89e86fe5fec1d8/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:00:43.489458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0300e9-b264-4622-a415-473fc07f5a06 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:43.533908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a345e78-f837-42b6-8b1b-66ffa6b631e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:43.534727 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345e78-f837-42b6-8b1b-66ffa6b631e4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:43.535000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345e78-f837-42b6-8b1b-66ffa6b631e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:43.535268 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345e78-f837-42b6-8b1b-66ffa6b631e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.548648 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a345e78-f837-42b6-8b1b-66ffa6b631e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:43.550302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a345e78-f837-42b6-8b1b-66ffa6b631e4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5a345e78-f837-42b6-8b1b-66ffa6b631e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:43.572156 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:43.574263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:43.577036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:43.577036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:43.577036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:43.577036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:43.580737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 538/1069] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:43.580954 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc762-e880-4525-98fd-6c239afcd664 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:43.625528 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdd9d8-5a7d-415f-b234-a24335fb586d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:43.625994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdd9d8-5a7d-415f-b234-a24335fb586d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:43.626324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdd9d8-5a7d-415f-b234-a24335fb586d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.628437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 539/1070] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:43.636122 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e1c0-dab8-4004-88ec-d7ea0e8f43b4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:43.636555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e1c0-dab8-4004-88ec-d7ea0e8f43b4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:43.637014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e1c0-dab8-4004-88ec-d7ea0e8f43b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.658347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6924e1c0-dab8-4004-88ec-d7ea0e8f43b4 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:43.660038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6924e1c0-dab8-4004-88ec-d7ea0e8f43b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:43.740136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc762-e880-4525-98fd-6c239afcd664 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:43.763979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 540/1071] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:43.799489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:43.800623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:43.801149 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:43.801642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:43.803097 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:43.803623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:43.804757 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e1c0-dab8-4004-88ec-d7ea0e8f43b4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:43.805828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:43.825022 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 532/1072] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:43.831869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:43.964512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541c60f-329d-430b-94c5-d3d590e01a6e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:43.967543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e1c0-dab8-4004-88ec-d7ea0e8f43b4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:44.019041 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:44.019868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:44.020855 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:44.021267 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:44.021603 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:44.021778 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:44.022237 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:44.022424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:44.023430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:44.025962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:44.031573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:44.033312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:44.038334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:44.040138 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:44.041278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 541/1073] 10.222.0.13 () {56 vars in 1105 bytes} [Mon May 16 14:00:43 2022] GET /identity/v3/services/image => generated 86 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:44.049686 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:44.055214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:44.057556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:44.059358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:44.059358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:44.059358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:44.059358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:44.059358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:44.059358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:44.059358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:44.059358 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:44.062818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 533/1074] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:44.063726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:44.199526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66186d-236e-49e2-9459-89690f9a4648 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:44.203099 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d556a4-12f5-4324-b5fe-84e7798b69d2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:44.241240 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:44.241910 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:44.242193 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:44.242466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:44.244138 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:44.244506 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:44.244773 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:44.245770 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:44.245993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:44.246181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:44.246580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:44.247802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:44.248287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:44.250906 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:44.263834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 534/1075] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:44.264062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 542/1076] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:44.265375 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:44.265749 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:44.379490 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f4a3e-dff2-41c5-823e-1c71a9ca0de7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:44.418532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c1713-6aac-4c63-9a96-c3f176c0d13e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:44.421389 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:44.422728 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:44.422728 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:44.422728 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:44.423316 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] RBAC: Adding query filter params (type=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:44.423618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:44.425084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:44.431463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 543/1077] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:44.437675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:44.471153 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646b9b8-d2b1-49ea-9ab5-6f88dd4ac4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:44.472524 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b9b8-d2b1-49ea-9ab5-6f88dd4ac4b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:44.473030 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b9b8-d2b1-49ea-9ab5-6f88dd4ac4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:44.473483 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b9b8-d2b1-49ea-9ab5-6f88dd4ac4b7 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/c40d0702d56d47b48afc200b4de3027f/roles/bb5fe8f8dac0489485dc9f5a8d41d465` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:44.477938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646b9b8-d2b1-49ea-9ab5-6f88dd4ac4b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=c40d0702d56d47b48afc200b4de3027f, role_id=bb5fe8f8dac0489485dc9f5a8d41d465)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:44.479653 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646b9b8-d2b1-49ea-9ab5-6f88dd4ac4b7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:44.509190 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 535/1078] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:00:44 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/c40d0702d56d47b48afc200b4de3027f/roles/bb5fe8f8dac0489485dc9f5a8d41d465 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:00:44.578802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b5e25-473e-4245-bbab-c2a20c91eb91 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:44.620337 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902a30d-49bd-4432-8c73-6c8fa28fab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:44.621334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a30d-49bd-4432-8c73-6c8fa28fab27 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:44.621782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a30d-49bd-4432-8c73-6c8fa28fab27 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:44.622197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a30d-49bd-4432-8c73-6c8fa28fab27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:44.623117 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902a30d-49bd-4432-8c73-6c8fa28fab27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:44.624752 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902a30d-49bd-4432-8c73-6c8fa28fab27 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:44.652780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 544/1079] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:00:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:00:45.896108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7cb7e-3cbf-430b-b51a-efc82b32be2d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:45.896984 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7cb7e-3cbf-430b-b51a-efc82b32be2d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:45.896984 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7cb7e-3cbf-430b-b51a-efc82b32be2d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:45.898311 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 536/1080] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:45.905265 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3247-c793-4654-9031-37134323cb48 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:45.906024 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3247-c793-4654-9031-37134323cb48 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:45.906024 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3247-c793-4654-9031-37134323cb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:45.925811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-631c3247-c793-4654-9031-37134323cb48 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:45.927017 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-631c3247-c793-4654-9031-37134323cb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:46.010048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 545/1081] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:00:46.034044 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7cb7e-3cbf-430b-b51a-efc82b32be2d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:46.163490 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7cb7e-3cbf-430b-b51a-efc82b32be2d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:46.201355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9033e-c5d0-42f1-b22f-219e911b8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:46.202170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9033e-c5d0-42f1-b22f-219e911b8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:46.202438 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9033e-c5d0-42f1-b22f-219e911b8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:46.202724 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9033e-c5d0-42f1-b22f-219e911b8fc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:46.214964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9033e-c5d0-42f1-b22f-219e911b8fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9aa9033e-c5d0-42f1-b22f-219e911b8fc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:46.222752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:46.233816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:46.235441 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 537/1082] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:46.238998 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3247-c793-4654-9031-37134323cb48 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:46.345185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3247-c793-4654-9031-37134323cb48 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:46.385340 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:46.386131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:46.386414 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:46.386689 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:46.387475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:46.387777 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:46.389286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:46.401008 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 546/1083] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:46.407569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9033e-c5d0-42f1-b22f-219e911b8fc9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:46.569727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9033e-c5d0-42f1-b22f-219e911b8fc9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:46.610627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fee17-f507-4ac2-8aab-4a7df478af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:46.611520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fee17-f507-4ac2-8aab-4a7df478af41 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:46.611805 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fee17-f507-4ac2-8aab-4a7df478af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:46.612092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fee17-f507-4ac2-8aab-4a7df478af41 None admin] PATH_INFO: `/v3/users/386efa9f495a47ebbf89e86fe5fec1d8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:46.613393 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fee17-f507-4ac2-8aab-4a7df478af41 None admin] RBAC: Authorizing `identity:get_user(user_id=386efa9f495a47ebbf89e86fe5fec1d8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:46.614844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fee17-f507-4ac2-8aab-4a7df478af41 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:46.616825 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 538/1084] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:00:46 2022] GET /identity/v3/users/386efa9f495a47ebbf89e86fe5fec1d8 => generated 285 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:46.623165 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:46.737793 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f1ec6-f674-44f3-8aa3-295878f42abf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:46.779311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46431522-48e3-45ac-b6cc-1b58e726f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:46.780371 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431522-48e3-45ac-b6cc-1b58e726f599 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:46.780921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431522-48e3-45ac-b6cc-1b58e726f599 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:46.781408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431522-48e3-45ac-b6cc-1b58e726f599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:46.905467 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46431522-48e3-45ac-b6cc-1b58e726f599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:46.908152 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46431522-48e3-45ac-b6cc-1b58e726f599 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:46.943100 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e8f4c-3216-4445-b74b-c0f45d6d69aa None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:46.943100 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e8f4c-3216-4445-b74b-c0f45d6d69aa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:46.943100 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e8f4c-3216-4445-b74b-c0f45d6d69aa None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:46.949082 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 539/1085] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:46.952318 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f82b6-ab09-41a6-bc6c-9f2e6a5851ec None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:46.952898 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f82b6-ab09-41a6-bc6c-9f2e6a5851ec None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:46.953389 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f82b6-ab09-41a6-bc6c-9f2e6a5851ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:46.981620 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1c0f82b6-ab09-41a6-bc6c-9f2e6a5851ec None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:46.983472 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1c0f82b6-ab09-41a6-bc6c-9f2e6a5851ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:47.054977 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 547/1086] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:00:47.061486 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46431522-48e3-45ac-b6cc-1b58e726f599 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:47.102189 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 540/1087] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:47.143858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f82b6-ab09-41a6-bc6c-9f2e6a5851ec None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:47.197207 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46431522-48e3-45ac-b6cc-1b58e726f599 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:47.255060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fad0d-c506-44ea-9efc-f4b3ad00f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:47.256546 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fad0d-c506-44ea-9efc-f4b3ad00f55b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:47.257077 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fad0d-c506-44ea-9efc-f4b3ad00f55b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:47.257537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fad0d-c506-44ea-9efc-f4b3ad00f55b None admin] PATH_INFO: `/v3/projects/5f1cb7829b45472baebcc188399c4e98` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:47.259803 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fad0d-c506-44ea-9efc-f4b3ad00f55b None admin] RBAC: Authorizing `identity:get_project(project_id=5f1cb7829b45472baebcc188399c4e98)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:47.262537 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fad0d-c506-44ea-9efc-f4b3ad00f55b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:47.265828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 548/1088] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:00:47 2022] GET /identity/v3/projects/5f1cb7829b45472baebcc188399c4e98 => generated 311 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:47.277155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fad0d-c506-44ea-9efc-f4b3ad00f55b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:47.320713 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f82b6-ab09-41a6-bc6c-9f2e6a5851ec None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:47.382551 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d31b-d055-4ef2-89bd-c249c0fecd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:47.385080 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d31b-d055-4ef2-89bd-c249c0fecd86 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:47.385786 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d31b-d055-4ef2-89bd-c249c0fecd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:47.386291 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d31b-d055-4ef2-89bd-c249c0fecd86 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:47.400175 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07d31b-d055-4ef2-89bd-c249c0fecd86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3e07d31b-d055-4ef2-89bd-c249c0fecd86 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:00:47.408769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:47.409972 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:00:47.411101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:47.412218 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fad0d-c506-44ea-9efc-f4b3ad00f55b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:47.415901 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 541/1089] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 14:00:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:47.417238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d31b-d055-4ef2-89bd-c249c0fecd86 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:47.464004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34e5ee-9945-4437-b6e2-cec17e3cb708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:47.464959 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34e5ee-9945-4437-b6e2-cec17e3cb708 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:47.465404 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34e5ee-9945-4437-b6e2-cec17e3cb708 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:47.465876 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34e5ee-9945-4437-b6e2-cec17e3cb708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:47.466942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34e5ee-9945-4437-b6e2-cec17e3cb708 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=5f1cb7829b45472baebcc188399c4e98, user.id=386efa9f495a47ebbf89e86fe5fec1d8) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:47.467409 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34e5ee-9945-4437-b6e2-cec17e3cb708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:47.469125 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34e5ee-9945-4437-b6e2-cec17e3cb708 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:47.476065 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 549/1090] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:47 2022] GET /identity/v3/role_assignments?user.id=386efa9f495a47ebbf89e86fe5fec1d8&scope.project.id=5f1cb7829b45472baebcc188399c4e98&role.id=52bf3a299728408b8384e30e08547fd8 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:47.605817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d31b-d055-4ef2-89bd-c249c0fecd86 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:47.626531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5af3-5d11-44bf-be90-05904295726f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:47.626842 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5af3-5d11-44bf-be90-05904295726f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:47.627159 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e5af3-5d11-44bf-be90-05904295726f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:47.628558 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 550/1091] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:47.636261 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b9e6e-fb0d-427a-a016-3289201a0b22 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:47.636748 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b9e6e-fb0d-427a-a016-3289201a0b22 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:47.637198 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b9e6e-fb0d-427a-a016-3289201a0b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:47.664190 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ef3b9e6e-fb0d-427a-a016-3289201a0b22 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:47.666701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ef3b9e6e-fb0d-427a-a016-3289201a0b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:47.674818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:47.676421 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:47.677170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:47.677839 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:47.679482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:47.680249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:47.683304 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:47.698626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 542/1092] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 14:00:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:47.707326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:47.777760 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 551/1093] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:47.802825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b9e6e-fb0d-427a-a016-3289201a0b22 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:47.871470 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49e0b3-3233-442d-a19d-10522fa0a9a3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:47.923867 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9818280-4f19-400f-8688-4d376058098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:47.924971 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9818280-4f19-400f-8688-4d376058098e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:47.925426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9818280-4f19-400f-8688-4d376058098e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:47.925776 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9818280-4f19-400f-8688-4d376058098e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:47.940747 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9818280-4f19-400f-8688-4d376058098e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:47.942574 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9818280-4f19-400f-8688-4d376058098e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:47.967308 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b9e6e-fb0d-427a-a016-3289201a0b22 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a9818280-4f19-400f-8688-4d376058098e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:47.969795 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:47.971964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:47.975140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:47.975140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:47.975140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:47.975140 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:47.978232 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 543/1094] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:47.982043 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9818280-4f19-400f-8688-4d376058098e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:48.020288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a009a-d485-4b5f-a54c-89847b0197f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:48.021566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a009a-d485-4b5f-a54c-89847b0197f2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:48.022019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a009a-d485-4b5f-a54c-89847b0197f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:48.022385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a009a-d485-4b5f-a54c-89847b0197f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:48.126572 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a009a-d485-4b5f-a54c-89847b0197f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:48.128351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a009a-d485-4b5f-a54c-89847b0197f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:48.129933 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9818280-4f19-400f-8688-4d376058098e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:48.194041 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:48.195491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:48.196269 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:48.197017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:48.198662 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:48.199380 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:48.202185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:48.225558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 544/1095] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:48.232767 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:48.295793 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 552/1096] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 14:00:48.301873 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a009a-d485-4b5f-a54c-89847b0197f2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:48.353942 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f48335-cc1e-4c4e-b72d-1927316ccffa None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:48.407331 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a009a-d485-4b5f-a54c-89847b0197f2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:48.413148 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:48.414507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:48.415537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:48.416037 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:48.429552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:48.432885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:48.444145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:48.444984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:48.445269 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:48.445544 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:48.456445 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:48.457962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:00:48.460955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:48.461885 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:00:48.462836 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:00:48.463848 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 545/1097] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 14:00:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:48.470256 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:48.478059 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:48.479193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:48.480118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:48.480118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:48.480118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:48.480118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:48.480118 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 553/1098] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:00:48.485476 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:48.593397 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da143-4f1a-4a43-832f-c886c7b49f4e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:48.627995 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231e46c-22bd-4417-b35a-60203d35abc3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:48.640249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:48.641474 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:48.641981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:48.642485 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:48.644098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:48.644750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:48.647371 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:48.667779 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:48.668369 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:48.668652 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:48.668983 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:48.670022 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:48.670022 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:48.671405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:48.675785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 546/1099] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 14:00:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:48.682526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:48.700719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 554/1100] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:48.860444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6738685-32ce-49fe-a6e7-c71d09c94eac None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:48.922029 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360506-0d06-4495-9e14-d313e1129908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:48.922926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360506-0d06-4495-9e14-d313e1129908 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:48.923354 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360506-0d06-4495-9e14-d313e1129908 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:48.923779 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360506-0d06-4495-9e14-d313e1129908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:49.047588 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9360506-0d06-4495-9e14-d313e1129908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:49.050400 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9360506-0d06-4495-9e14-d313e1129908 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:49.237014 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 547/1101] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 14:00:49.243280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:49.364736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c6499-4074-496d-9ed8-7278e61d0d29 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:49.404342 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:49.405305 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:49.405684 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:49.406051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:49.418311 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:49.419988 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:00:49.438762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:49.441018 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:49.443745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:00:49.443745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:00:49.443745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:00:49.443745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:49.443745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 555/1102] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:49.449128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360506-0d06-4495-9e14-d313e1129908 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:49.627946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360506-0d06-4495-9e14-d313e1129908 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:49.679543 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:49.681057 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:49.681510 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:49.681931 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:49.683193 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:49.683711 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:49.685643 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:49.713065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 548/1103] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:49.715079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:49.882470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386bd41-7690-4a5e-823d-2db3cf841706 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:49.931915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:49.933390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:49.933878 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:49.934353 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:49.952313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:49.955000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:00:49.984149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:00:49.985302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:00:49.986345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:00:49.986345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:00:49.986345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:00:49.986345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:00:49.986345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:00:49.986345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:00:49.986345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:00:49.986345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:00:49.995072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 556/1104] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:00:49.996818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:50.158395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea855738-ba8a-4015-8718-1a8f0ce1220e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:50.199497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8ab19-9462-40c9-ac18-d52e17486d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:50.200607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ab19-9462-40c9-ac18-d52e17486d2a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:50.201151 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ab19-9462-40c9-ac18-d52e17486d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:50.201642 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ab19-9462-40c9-ac18-d52e17486d2a None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:50.203193 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8ab19-9462-40c9-ac18-d52e17486d2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:50.203742 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8ab19-9462-40c9-ac18-d52e17486d2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:50.206488 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8ab19-9462-40c9-ac18-d52e17486d2a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:50.235803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 549/1105] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:50.237740 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:50.249942 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5851-ea61-4eca-8a28-121f8c783df7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:50.250231 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5851-ea61-4eca-8a28-121f8c783df7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:50.250507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5851-ea61-4eca-8a28-121f8c783df7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:50.252092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 550/1106] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:50.257970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c703bf-d567-4482-8f71-f1d85626074a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:50.258253 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c703bf-d567-4482-8f71-f1d85626074a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:50.258530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c703bf-d567-4482-8f71-f1d85626074a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:50.275752 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e8c703bf-d567-4482-8f71-f1d85626074a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:50.277039 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e8c703bf-d567-4482-8f71-f1d85626074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:50.356489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 551/1107] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:50.382343 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c703bf-d567-4482-8f71-f1d85626074a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:50.385161 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9dceb-2912-436e-8712-5b477981c35b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:50.425000 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:50.425893 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:50.426236 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:50.426616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:50.427597 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] RBAC: Adding query filter params (role.id=bb5fe8f8dac0489485dc9f5a8d41d465, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=c40d0702d56d47b48afc200b4de3027f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:50.428004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:50.429606 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:50.448745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 557/1108] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:50 2022] GET /identity/v3/role_assignments?user.id=c40d0702d56d47b48afc200b4de3027f&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=bb5fe8f8dac0489485dc9f5a8d41d465 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:50.499961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c703bf-d567-4482-8f71-f1d85626074a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:50.545538 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2dd00-4e08-49cc-8bdc-8db308f8abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:50.546493 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2dd00-4e08-49cc-8bdc-8db308f8abde None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:50.546866 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2dd00-4e08-49cc-8bdc-8db308f8abde None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:50.547241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2dd00-4e08-49cc-8bdc-8db308f8abde None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:50.549277 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2dd00-4e08-49cc-8bdc-8db308f8abde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:50.550946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2dd00-4e08-49cc-8bdc-8db308f8abde None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:50.552924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 552/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:50.559729 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:50.715331 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2b7fe-979d-4af3-994d-d27518589953 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:50.757755 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169370b-0995-4f42-ac31-87e8870edf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:50.758447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169370b-0995-4f42-ac31-87e8870edf9b None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:50.759255 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169370b-0995-4f42-ac31-87e8870edf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:50.759549 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169370b-0995-4f42-ac31-87e8870edf9b None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:50.760775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169370b-0995-4f42-ac31-87e8870edf9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:50.762244 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169370b-0995-4f42-ac31-87e8870edf9b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:50.788621 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 558/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 14:00:50 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:00:53.262905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ae43-da86-4772-b98b-3e6ad03808b5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:53.263461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ae43-da86-4772-b98b-3e6ad03808b5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:53.263461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ae43-da86-4772-b98b-3e6ad03808b5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:53.264864 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 553/1111] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:53.270687 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a9d56-ef54-4f7c-bfa4-c8deb8acc0df None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:53.271245 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a9d56-ef54-4f7c-bfa4-c8deb8acc0df None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:53.271376 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a9d56-ef54-4f7c-bfa4-c8deb8acc0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:53.289386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-415a9d56-ef54-4f7c-bfa4-c8deb8acc0df None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:53.291452 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-415a9d56-ef54-4f7c-bfa4-c8deb8acc0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:53.370333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 559/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:53.395275 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53ae43-da86-4772-b98b-3e6ad03808b5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:53.507455 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53ae43-da86-4772-b98b-3e6ad03808b5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:53.549274 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9fa8c-595d-4148-8cdf-0ef0a1bbec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:53.550058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fa8c-595d-4148-8cdf-0ef0a1bbec6b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:53.550337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fa8c-595d-4148-8cdf-0ef0a1bbec6b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:53.550612 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fa8c-595d-4148-8cdf-0ef0a1bbec6b None admin] PATH_INFO: `/v3/roles/b38b04aec27e41b9a8c2824918eedd12` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:53.552186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9fa8c-595d-4148-8cdf-0ef0a1bbec6b None admin] RBAC: Authorizing `identity:get_role(role_id=b38b04aec27e41b9a8c2824918eedd12)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:53.553609 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9fa8c-595d-4148-8cdf-0ef0a1bbec6b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:53.555052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 554/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:00:53 2022] GET /identity/v3/roles/b38b04aec27e41b9a8c2824918eedd12 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:53.561701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a9d56-ef54-4f7c-bfa4-c8deb8acc0df None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:53.669133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a9d56-ef54-4f7c-bfa4-c8deb8acc0df None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:53.708319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4803-2bff-430c-b2d4-b6b91ef08959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:53.709315 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4803-2bff-430c-b2d4-b6b91ef08959 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:53.709646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4803-2bff-430c-b2d4-b6b91ef08959 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:53.709976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4803-2bff-430c-b2d4-b6b91ef08959 None admin] PATH_INFO: `/v3/users/ff33e0315e9143a4add795fd4883a547` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:53.726214 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4803-2bff-430c-b2d4-b6b91ef08959 None admin] RBAC: Authorizing `identity:get_user(user_id=ff33e0315e9143a4add795fd4883a547)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:53.728380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4803-2bff-430c-b2d4-b6b91ef08959 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:53.731347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 560/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:00:53 2022] GET /identity/v3/users/ff33e0315e9143a4add795fd4883a547 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:53.737555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9fa8c-595d-4148-8cdf-0ef0a1bbec6b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:53.846518 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9fa8c-595d-4148-8cdf-0ef0a1bbec6b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:53.882982 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69392-3a97-41d1-9a80-f01b264d62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:53.883647 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69392-3a97-41d1-9a80-f01b264d62f5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:53.883936 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69392-3a97-41d1-9a80-f01b264d62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:53.884264 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69392-3a97-41d1-9a80-f01b264d62f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:53.974659 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea69392-3a97-41d1-9a80-f01b264d62f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:53.977451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea69392-3a97-41d1-9a80-f01b264d62f5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:54.151177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 555/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:00:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 14:00:54.157137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4803-2bff-430c-b2d4-b6b91ef08959 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:54.264914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4803-2bff-430c-b2d4-b6b91ef08959 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:54.298307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8249af-084c-4814-a5c2-47203bafdab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:54.299171 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8249af-084c-4814-a5c2-47203bafdab7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:54.299450 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8249af-084c-4814-a5c2-47203bafdab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:54.299721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8249af-084c-4814-a5c2-47203bafdab7 None admin] PATH_INFO: `/v3/projects/5f1cb7829b45472baebcc188399c4e98` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:54.300985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8249af-084c-4814-a5c2-47203bafdab7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f1cb7829b45472baebcc188399c4e98)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:54.302426 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8249af-084c-4814-a5c2-47203bafdab7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:54.304150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 561/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:00:54 2022] GET /identity/v3/projects/5f1cb7829b45472baebcc188399c4e98 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:54.311048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69392-3a97-41d1-9a80-f01b264d62f5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:54.411835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69392-3a97-41d1-9a80-f01b264d62f5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:54.445946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939008fc-0d52-464c-bf1f-bafafebfa7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:54.447132 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939008fc-0d52-464c-bf1f-bafafebfa7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:54.447405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939008fc-0d52-464c-bf1f-bafafebfa7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:54.447676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939008fc-0d52-464c-bf1f-bafafebfa7d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:54.448509 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939008fc-0d52-464c-bf1f-bafafebfa7d9 None admin] RBAC: Adding query filter params (role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=5f1cb7829b45472baebcc188399c4e98, user.id=ff33e0315e9143a4add795fd4883a547) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:00:54.448851 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939008fc-0d52-464c-bf1f-bafafebfa7d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:54.450289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939008fc-0d52-464c-bf1f-bafafebfa7d9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:54.456223 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 556/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:00:54 2022] GET /identity/v3/role_assignments?user.id=ff33e0315e9143a4add795fd4883a547&scope.project.id=5f1cb7829b45472baebcc188399c4e98&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:56.758621 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994b89-ff69-4eb7-9df0-240dee0c56be None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:56.759348 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994b89-ff69-4eb7-9df0-240dee0c56be None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:56.759348 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994b89-ff69-4eb7-9df0-240dee0c56be None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:56.760866 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 562/1118] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:00:56.767060 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b26dc6-8fec-4add-bb7e-82fed33ffcaa None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:56.767606 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b26dc6-8fec-4add-bb7e-82fed33ffcaa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:56.767606 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b26dc6-8fec-4add-bb7e-82fed33ffcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:56.785442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-66b26dc6-8fec-4add-bb7e-82fed33ffcaa None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:56.786672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-66b26dc6-8fec-4add-bb7e-82fed33ffcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:56.859101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 557/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:00:56.882812 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab994b89-ff69-4eb7-9df0-240dee0c56be None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:56.995445 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab994b89-ff69-4eb7-9df0-240dee0c56be None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:57.038239 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b0b15-4840-4f6a-bd91-d5794dabb6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:57.039041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b0b15-4840-4f6a-bd91-d5794dabb6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:57.039321 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b0b15-4840-4f6a-bd91-d5794dabb6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:57.039594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b0b15-4840-4f6a-bd91-d5794dabb6b5 None admin] PATH_INFO: `/v3/roles/b38b04aec27e41b9a8c2824918eedd12` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:57.041379 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b0b15-4840-4f6a-bd91-d5794dabb6b5 None admin] RBAC: Authorizing `identity:get_role(role_id=b38b04aec27e41b9a8c2824918eedd12)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:57.042823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b0b15-4840-4f6a-bd91-d5794dabb6b5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:57.044340 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 563/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:00:56 2022] GET /identity/v3/roles/b38b04aec27e41b9a8c2824918eedd12 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:57.050710 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b26dc6-8fec-4add-bb7e-82fed33ffcaa None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:57.151291 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b26dc6-8fec-4add-bb7e-82fed33ffcaa None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:57.185257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd27fa-fb6c-431f-a443-e63a0f7be042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:57.186137 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd27fa-fb6c-431f-a443-e63a0f7be042 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:57.186411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd27fa-fb6c-431f-a443-e63a0f7be042 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:57.186685 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd27fa-fb6c-431f-a443-e63a0f7be042 None admin] PATH_INFO: `/v3/users/ff33e0315e9143a4add795fd4883a547` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:57.187897 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd27fa-fb6c-431f-a443-e63a0f7be042 None admin] RBAC: Authorizing `identity:get_user(user_id=ff33e0315e9143a4add795fd4883a547)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:57.189356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd27fa-fb6c-431f-a443-e63a0f7be042 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:57.191035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 558/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:00:57 2022] GET /identity/v3/users/ff33e0315e9143a4add795fd4883a547 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:00:57.197721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b0b15-4840-4f6a-bd91-d5794dabb6b5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:57.300435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b0b15-4840-4f6a-bd91-d5794dabb6b5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:57.351843 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be1d48-81f1-4599-9947-68d395db1c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:57.352728 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1d48-81f1-4599-9947-68d395db1c9f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:57.353499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1d48-81f1-4599-9947-68d395db1c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:57.354475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1d48-81f1-4599-9947-68d395db1c9f None admin] PATH_INFO: `/v3/projects/5f1cb7829b45472baebcc188399c4e98` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:57.355729 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be1d48-81f1-4599-9947-68d395db1c9f None admin] RBAC: Authorizing `identity:get_project(project_id=5f1cb7829b45472baebcc188399c4e98)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:57.357463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be1d48-81f1-4599-9947-68d395db1c9f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:57.359215 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 564/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:00:57 2022] GET /identity/v3/projects/5f1cb7829b45472baebcc188399c4e98 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:00:57.365360 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd27fa-fb6c-431f-a443-e63a0f7be042 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:00:57.466498 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd27fa-fb6c-431f-a443-e63a0f7be042 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:00:57.502387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85269c0-13e8-44ae-ac00-8f76c3533517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:00:57.503282 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85269c0-13e8-44ae-ac00-8f76c3533517 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:57.503570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85269c0-13e8-44ae-ac00-8f76c3533517 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:57.503837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85269c0-13e8-44ae-ac00-8f76c3533517 None admin] PATH_INFO: `/v3/projects/5f1cb7829b45472baebcc188399c4e98/users/ff33e0315e9143a4add795fd4883a547/roles/b38b04aec27e41b9a8c2824918eedd12` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:57.506286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85269c0-13e8-44ae-ac00-8f76c3533517 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f1cb7829b45472baebcc188399c4e98, user_id=ff33e0315e9143a4add795fd4883a547, role_id=b38b04aec27e41b9a8c2824918eedd12)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:00:57.508103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85269c0-13e8-44ae-ac00-8f76c3533517 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:00:57.522548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 559/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:00:57 2022] PUT /identity/v3/projects/5f1cb7829b45472baebcc188399c4e98/users/ff33e0315e9143a4add795fd4883a547/roles/b38b04aec27e41b9a8c2824918eedd12 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:00:59.874716 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25044-c595-4faf-82a3-7dcfe27e0588 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:59.875335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25044-c595-4faf-82a3-7dcfe27e0588 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:59.875335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25044-c595-4faf-82a3-7dcfe27e0588 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:59.876697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 565/1124] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:00:59.883405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679db46-44f5-41be-bdf7-75e65b8bf40d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:00:59.883989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679db46-44f5-41be-bdf7-75e65b8bf40d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:00:59.883989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679db46-44f5-41be-bdf7-75e65b8bf40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:00:59.904134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9679db46-44f5-41be-bdf7-75e65b8bf40d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:00:59.905493 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9679db46-44f5-41be-bdf7-75e65b8bf40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:00:59.992392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 560/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:00:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:00.018999 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25044-c595-4faf-82a3-7dcfe27e0588 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:00.137427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25044-c595-4faf-82a3-7dcfe27e0588 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:00.178243 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9ef8c-3713-4090-a54b-bcd9c507d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:00.179197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9ef8c-3713-4090-a54b-bcd9c507d8bb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:00.179526 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9ef8c-3713-4090-a54b-bcd9c507d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:00.179848 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9ef8c-3713-4090-a54b-bcd9c507d8bb None admin] PATH_INFO: `/v3/roles/b38b04aec27e41b9a8c2824918eedd12` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:00.182403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9ef8c-3713-4090-a54b-bcd9c507d8bb None admin] RBAC: Authorizing `identity:get_role(role_id=b38b04aec27e41b9a8c2824918eedd12)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:00.183927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9ef8c-3713-4090-a54b-bcd9c507d8bb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:00.185575 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 566/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:01:00 2022] GET /identity/v3/roles/b38b04aec27e41b9a8c2824918eedd12 => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:00.191981 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679db46-44f5-41be-bdf7-75e65b8bf40d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:00.302278 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679db46-44f5-41be-bdf7-75e65b8bf40d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:00.342225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5638ca3-bd52-4b0c-97fb-d384645b2021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:00.343123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5638ca3-bd52-4b0c-97fb-d384645b2021 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:00.343403 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5638ca3-bd52-4b0c-97fb-d384645b2021 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:00.343679 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5638ca3-bd52-4b0c-97fb-d384645b2021 None admin] PATH_INFO: `/v3/users/ff33e0315e9143a4add795fd4883a547` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:00.345039 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5638ca3-bd52-4b0c-97fb-d384645b2021 None admin] RBAC: Authorizing `identity:get_user(user_id=ff33e0315e9143a4add795fd4883a547)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:00.346529 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5638ca3-bd52-4b0c-97fb-d384645b2021 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:00.348300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 561/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:01:00 2022] GET /identity/v3/users/ff33e0315e9143a4add795fd4883a547 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:00.355039 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9ef8c-3713-4090-a54b-bcd9c507d8bb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:00.458584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9ef8c-3713-4090-a54b-bcd9c507d8bb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:00.495283 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf9d3-1476-48f0-a83c-c24e9e3cf8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:00.495949 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf9d3-1476-48f0-a83c-c24e9e3cf8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:00.496234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf9d3-1476-48f0-a83c-c24e9e3cf8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:00.496510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf9d3-1476-48f0-a83c-c24e9e3cf8a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:00.567674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcf9d3-1476-48f0-a83c-c24e9e3cf8a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:00.569246 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcf9d3-1476-48f0-a83c-c24e9e3cf8a5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:00.678648 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 567/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:01:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:01:00.685068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5638ca3-bd52-4b0c-97fb-d384645b2021 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:00.786630 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5638ca3-bd52-4b0c-97fb-d384645b2021 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:00.822835 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39cf44-b1e1-4f07-81c2-858849f07213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:00.823733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39cf44-b1e1-4f07-81c2-858849f07213 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:00.824007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39cf44-b1e1-4f07-81c2-858849f07213 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:00.824275 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39cf44-b1e1-4f07-81c2-858849f07213 None admin] PATH_INFO: `/v3/projects/5f1cb7829b45472baebcc188399c4e98` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:00.825569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39cf44-b1e1-4f07-81c2-858849f07213 None admin] RBAC: Authorizing `identity:get_project(project_id=5f1cb7829b45472baebcc188399c4e98)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:00.827004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39cf44-b1e1-4f07-81c2-858849f07213 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:00.828758 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 562/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:01:00 2022] GET /identity/v3/projects/5f1cb7829b45472baebcc188399c4e98 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:00.839025 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf9d3-1476-48f0-a83c-c24e9e3cf8a5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:00.943012 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf9d3-1476-48f0-a83c-c24e9e3cf8a5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:00.980690 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbef2f-417a-480a-8837-ca6f89c0e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:00.981380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbef2f-417a-480a-8837-ca6f89c0e774 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:00.981925 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbef2f-417a-480a-8837-ca6f89c0e774 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:00.982200 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbef2f-417a-480a-8837-ca6f89c0e774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:00.983041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbef2f-417a-480a-8837-ca6f89c0e774 None admin] RBAC: Adding query filter params (role.id=b38b04aec27e41b9a8c2824918eedd12, scope.project.id=5f1cb7829b45472baebcc188399c4e98, user.id=ff33e0315e9143a4add795fd4883a547) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:00.983347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbef2f-417a-480a-8837-ca6f89c0e774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:00.984801 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbef2f-417a-480a-8837-ca6f89c0e774 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:00.991169 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 568/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:01:00 2022] GET /identity/v3/role_assignments?user.id=ff33e0315e9143a4add795fd4883a547&scope.project.id=5f1cb7829b45472baebcc188399c4e98&role.id=b38b04aec27e41b9a8c2824918eedd12 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:03.316540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66021f2-da4f-49ec-a7d6-b008417ac6a3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:03.317154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66021f2-da4f-49ec-a7d6-b008417ac6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:03.317154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66021f2-da4f-49ec-a7d6-b008417ac6a3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:03.318526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 563/1131] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:01:03.328320 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da552abb-80e7-4334-ab02-8c00251187e3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:03.328886 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da552abb-80e7-4334-ab02-8c00251187e3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:03.329015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da552abb-80e7-4334-ab02-8c00251187e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:03.347721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-da552abb-80e7-4334-ab02-8c00251187e3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:03.349009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-da552abb-80e7-4334-ab02-8c00251187e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:03.421471 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 569/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:03.447100 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66021f2-da4f-49ec-a7d6-b008417ac6a3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:03.576540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66021f2-da4f-49ec-a7d6-b008417ac6a3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:03.613360 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da69b3e-aa21-4793-a830-465240c2cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:03.614195 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da69b3e-aa21-4793-a830-465240c2cde5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:03.614480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da69b3e-aa21-4793-a830-465240c2cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:03.614756 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da69b3e-aa21-4793-a830-465240c2cde5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:03.616126 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da69b3e-aa21-4793-a830-465240c2cde5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:03.617640 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da69b3e-aa21-4793-a830-465240c2cde5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:03.620628 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 564/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:01:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:03.627555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da552abb-80e7-4334-ab02-8c00251187e3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:03.786324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da552abb-80e7-4334-ab02-8c00251187e3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:03.845531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f1b77-5bea-4de3-afce-6010abc28fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:03.846593 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1b77-5bea-4de3-afce-6010abc28fb4 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:03.847097 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1b77-5bea-4de3-afce-6010abc28fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:03.847607 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1b77-5bea-4de3-afce-6010abc28fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:03.848989 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1b77-5bea-4de3-afce-6010abc28fb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:03.851738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1b77-5bea-4de3-afce-6010abc28fb4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:03.885785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 570/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:01:03 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:01:06.250012 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f197283-2aaa-46cc-a96e-948baef194ea None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:06.250603 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f197283-2aaa-46cc-a96e-948baef194ea None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:06.250603 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f197283-2aaa-46cc-a96e-948baef194ea None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:06.252461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 565/1135] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:06.259352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33d77f-0f33-4bca-ab38-9932e0980814 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:06.260441 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33d77f-0f33-4bca-ab38-9932e0980814 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:06.260587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33d77f-0f33-4bca-ab38-9932e0980814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:06.278213 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4f33d77f-0f33-4bca-ab38-9932e0980814 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:06.279418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4f33d77f-0f33-4bca-ab38-9932e0980814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:06.358554 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 571/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:06.386002 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f197283-2aaa-46cc-a96e-948baef194ea None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:06.497045 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f197283-2aaa-46cc-a96e-948baef194ea None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:06.535222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccebc3-1ada-4194-9380-b27b842e017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:06.535921 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccebc3-1ada-4194-9380-b27b842e017f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:06.536221 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccebc3-1ada-4194-9380-b27b842e017f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:06.536446 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccebc3-1ada-4194-9380-b27b842e017f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:06.537649 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccebc3-1ada-4194-9380-b27b842e017f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:06.539068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccebc3-1ada-4194-9380-b27b842e017f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:06.540711 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 566/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:01:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:01:06.550507 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33d77f-0f33-4bca-ab38-9932e0980814 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:06.669938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33d77f-0f33-4bca-ab38-9932e0980814 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:06.709442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea18e78-a64c-49f6-9ce2-d321a5db6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:06.710190 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18e78-a64c-49f6-9ce2-d321a5db6866 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:06.710522 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18e78-a64c-49f6-9ce2-d321a5db6866 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:06.710855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18e78-a64c-49f6-9ce2-d321a5db6866 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:06.711629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea18e78-a64c-49f6-9ce2-d321a5db6866 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:06.713291 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea18e78-a64c-49f6-9ce2-d321a5db6866 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:06.736740 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 572/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 14:01:06 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:01:09.168575 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127a66-919a-4961-bbe2-4a061d86b7a7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:09.169210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127a66-919a-4961-bbe2-4a061d86b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:09.169210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127a66-919a-4961-bbe2-4a061d86b7a7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:09.170635 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 567/1139] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:09.176519 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfaa2c-e1c2-4739-9be2-82a8ec737587 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:09.177053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfaa2c-e1c2-4739-9be2-82a8ec737587 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:09.177164 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfaa2c-e1c2-4739-9be2-82a8ec737587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:09.195148 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a2cfaa2c-e1c2-4739-9be2-82a8ec737587 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:09.196352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a2cfaa2c-e1c2-4739-9be2-82a8ec737587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:09.271941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 573/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:09.297193 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127a66-919a-4961-bbe2-4a061d86b7a7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:09.400350 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127a66-919a-4961-bbe2-4a061d86b7a7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:09.440359 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f085b-fc6b-4904-9a1f-4d3fb3c3f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:09.441118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f085b-fc6b-4904-9a1f-4d3fb3c3f790 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:09.441397 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f085b-fc6b-4904-9a1f-4d3fb3c3f790 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:09.441671 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f085b-fc6b-4904-9a1f-4d3fb3c3f790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:09.454370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f085b-fc6b-4904-9a1f-4d3fb3c3f790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f96f085b-fc6b-4904-9a1f-4d3fb3c3f790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:01:09.462325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:01:09.464333 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:01:09.465473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 568/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:01:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:01:09.470386 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfaa2c-e1c2-4739-9be2-82a8ec737587 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:09.586984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfaa2c-e1c2-4739-9be2-82a8ec737587 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:09.624173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:09.624904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:09.625189 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:09.625465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:09.626234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:09.626541 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:09.627944 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:09.637699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 574/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:01:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:09.643723 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f085b-fc6b-4904-9a1f-4d3fb3c3f790 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:09.750570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f085b-fc6b-4904-9a1f-4d3fb3c3f790 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:09.786009 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd979f-fdaf-484e-9e1b-ead01e3cb731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:09.786886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd979f-fdaf-484e-9e1b-ead01e3cb731 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:09.787166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd979f-fdaf-484e-9e1b-ead01e3cb731 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:09.787439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd979f-fdaf-484e-9e1b-ead01e3cb731 None admin] PATH_INFO: `/v3/users/2e9628ad308b4fa89b70c33829d0b240` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:09.808573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd979f-fdaf-484e-9e1b-ead01e3cb731 None admin] RBAC: Authorizing `identity:get_user(user_id=2e9628ad308b4fa89b70c33829d0b240)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:09.810092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd979f-fdaf-484e-9e1b-ead01e3cb731 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:09.811908 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 569/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:01:09 2022] GET /identity/v3/users/2e9628ad308b4fa89b70c33829d0b240 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:09.818162 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:09.930120 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608c0b5-276c-4b09-83f5-e7fbb0aa6788 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:09.971972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3249b3-8b3b-4a21-b898-52344ca11d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:09.972817 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3249b3-8b3b-4a21-b898-52344ca11d0c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:09.973197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3249b3-8b3b-4a21-b898-52344ca11d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:09.973555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3249b3-8b3b-4a21-b898-52344ca11d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:10.050973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3249b3-8b3b-4a21-b898-52344ca11d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:10.052345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3249b3-8b3b-4a21-b898-52344ca11d0c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:10.196910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 575/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:01:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:01:10.202988 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd979f-fdaf-484e-9e1b-ead01e3cb731 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:10.303288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd979f-fdaf-484e-9e1b-ead01e3cb731 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:10.339274 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2aeac5-c7ee-4a60-8c15-a33664b6a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:10.340181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2aeac5-c7ee-4a60-8c15-a33664b6a2ac None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:10.340459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2aeac5-c7ee-4a60-8c15-a33664b6a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:10.340761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2aeac5-c7ee-4a60-8c15-a33664b6a2ac None admin] PATH_INFO: `/v3/projects/7e4555dad3094fedb0cf0edb96328d8e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:10.341969 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2aeac5-c7ee-4a60-8c15-a33664b6a2ac None admin] RBAC: Authorizing `identity:get_project(project_id=7e4555dad3094fedb0cf0edb96328d8e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:10.343409 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2aeac5-c7ee-4a60-8c15-a33664b6a2ac None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:10.345180 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 570/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:01:10 2022] GET /identity/v3/projects/7e4555dad3094fedb0cf0edb96328d8e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:10.351614 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3249b3-8b3b-4a21-b898-52344ca11d0c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:10.454703 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3249b3-8b3b-4a21-b898-52344ca11d0c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:10.489388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91989-1b5a-41a5-8a1c-df4916afc4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:10.490052 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91989-1b5a-41a5-8a1c-df4916afc4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:10.490331 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91989-1b5a-41a5-8a1c-df4916afc4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:10.490603 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91989-1b5a-41a5-8a1c-df4916afc4f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:10.491435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91989-1b5a-41a5-8a1c-df4916afc4f0 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=7e4555dad3094fedb0cf0edb96328d8e, user.id=2e9628ad308b4fa89b70c33829d0b240) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:10.491741 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91989-1b5a-41a5-8a1c-df4916afc4f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:10.493206 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91989-1b5a-41a5-8a1c-df4916afc4f0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:10.499931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 576/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:01:10 2022] GET /identity/v3/role_assignments?user.id=2e9628ad308b4fa89b70c33829d0b240&scope.project.id=7e4555dad3094fedb0cf0edb96328d8e&role.id=52bf3a299728408b8384e30e08547fd8 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:01:12.905549 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5171f-ff01-4944-bbd5-8034e135a440 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:12.906110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5171f-ff01-4944-bbd5-8034e135a440 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:12.906110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5171f-ff01-4944-bbd5-8034e135a440 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:12.907369 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 571/1147] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:01:12.913985 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc2c22-2919-442d-a330-b591049b0a8a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:12.914580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc2c22-2919-442d-a330-b591049b0a8a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:12.914580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc2c22-2919-442d-a330-b591049b0a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:12.944035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-40cc2c22-2919-442d-a330-b591049b0a8a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:12.947345 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-40cc2c22-2919-442d-a330-b591049b0a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:13.031263 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 577/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:13.054916 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5171f-ff01-4944-bbd5-8034e135a440 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:13.176469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5171f-ff01-4944-bbd5-8034e135a440 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:13.217834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b222e32-3066-4476-9e33-10c10ecbcc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:13.218691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b222e32-3066-4476-9e33-10c10ecbcc55 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:13.219023 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b222e32-3066-4476-9e33-10c10ecbcc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:13.219344 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b222e32-3066-4476-9e33-10c10ecbcc55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:13.231683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b222e32-3066-4476-9e33-10c10ecbcc55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5b222e32-3066-4476-9e33-10c10ecbcc55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:01:13.239817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:01:13.241785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:01:13.243419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 572/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:01:13.247564 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc2c22-2919-442d-a330-b591049b0a8a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:13.378774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc2c22-2919-442d-a330-b591049b0a8a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:13.431712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:13.433010 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:13.433498 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:13.433987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:13.434784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:13.435095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:13.436520 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:13.453201 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 578/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:01:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:01:13.462921 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b222e32-3066-4476-9e33-10c10ecbcc55 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:13.623541 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b222e32-3066-4476-9e33-10c10ecbcc55 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:13.658648 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8a95e-6cb6-471b-bd05-3cc209986609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:13.659521 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a95e-6cb6-471b-bd05-3cc209986609 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:13.659804 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a95e-6cb6-471b-bd05-3cc209986609 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:13.660079 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a95e-6cb6-471b-bd05-3cc209986609 None admin] PATH_INFO: `/v3/users/2e9628ad308b4fa89b70c33829d0b240` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:13.661299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8a95e-6cb6-471b-bd05-3cc209986609 None admin] RBAC: Authorizing `identity:get_user(user_id=2e9628ad308b4fa89b70c33829d0b240)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:13.662730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8a95e-6cb6-471b-bd05-3cc209986609 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:13.664378 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 573/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:01:13 2022] GET /identity/v3/users/2e9628ad308b4fa89b70c33829d0b240 => generated 286 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:13.671085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:13.801252 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5bfd0-6eae-4c30-b4de-e70c317b0926 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:13.845823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87592-ea40-410e-aed3-3df5928c5bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:13.846685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87592-ea40-410e-aed3-3df5928c5bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:13.846969 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87592-ea40-410e-aed3-3df5928c5bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:13.847244 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87592-ea40-410e-aed3-3df5928c5bb5 None admin] PATH_INFO: `/v3/projects/7e4555dad3094fedb0cf0edb96328d8e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:13.848482 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87592-ea40-410e-aed3-3df5928c5bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=7e4555dad3094fedb0cf0edb96328d8e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:13.849953 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87592-ea40-410e-aed3-3df5928c5bb5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:13.851660 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 579/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:01:13 2022] GET /identity/v3/projects/7e4555dad3094fedb0cf0edb96328d8e => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:13.858772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8a95e-6cb6-471b-bd05-3cc209986609 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:13.976883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8a95e-6cb6-471b-bd05-3cc209986609 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:14.032915 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a80aa-3fee-42ab-a5b2-9a023bfadcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:14.033808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a80aa-3fee-42ab-a5b2-9a023bfadcaa None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:14.034093 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a80aa-3fee-42ab-a5b2-9a023bfadcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:14.034367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a80aa-3fee-42ab-a5b2-9a023bfadcaa None admin] PATH_INFO: `/v3/projects/7e4555dad3094fedb0cf0edb96328d8e/users/2e9628ad308b4fa89b70c33829d0b240/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:14.036590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a80aa-3fee-42ab-a5b2-9a023bfadcaa None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4555dad3094fedb0cf0edb96328d8e, user_id=2e9628ad308b4fa89b70c33829d0b240, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:14.038214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a80aa-3fee-42ab-a5b2-9a023bfadcaa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:14.059802 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 574/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:01:13 2022] PUT /identity/v3/projects/7e4555dad3094fedb0cf0edb96328d8e/users/2e9628ad308b4fa89b70c33829d0b240/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:01:16.399324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f727-e7fa-4651-b363-27f6e0b4f819 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:16.399928 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f727-e7fa-4651-b363-27f6e0b4f819 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:16.399928 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f727-e7fa-4651-b363-27f6e0b4f819 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:16.402161 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 580/1154] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:16.408211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee5d8-1e8d-4556-8996-37ec1534433a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:16.408804 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee5d8-1e8d-4556-8996-37ec1534433a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:16.408804 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee5d8-1e8d-4556-8996-37ec1534433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:16.425725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3cbee5d8-1e8d-4556-8996-37ec1534433a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:16.426992 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3cbee5d8-1e8d-4556-8996-37ec1534433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:16.497787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 575/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:16.522816 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f727-e7fa-4651-b363-27f6e0b4f819 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:16.635444 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f727-e7fa-4651-b363-27f6e0b4f819 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:16.673211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02c784-71ed-45cf-8848-77f6c61bb0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:16.673936 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c784-71ed-45cf-8848-77f6c61bb0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:16.674218 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c784-71ed-45cf-8848-77f6c61bb0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:16.674490 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c784-71ed-45cf-8848-77f6c61bb0d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:16.687846 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02c784-71ed-45cf-8848-77f6c61bb0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-eb02c784-71ed-45cf-8848-77f6c61bb0d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:01:16.695642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:01:16.697465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:01:16.698954 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 581/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:01:16.705487 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee5d8-1e8d-4556-8996-37ec1534433a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:16.815727 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee5d8-1e8d-4556-8996-37ec1534433a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:16.852505 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:16.853296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:16.853623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:16.853943 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:16.854879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:16.855216 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:16.856698 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:16.866114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 576/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:16.872383 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02c784-71ed-45cf-8848-77f6c61bb0d4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:16.973499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02c784-71ed-45cf-8848-77f6c61bb0d4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:17.008598 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137bf7e-4daf-4bc1-8628-577578e13bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:17.009500 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137bf7e-4daf-4bc1-8628-577578e13bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:17.009780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137bf7e-4daf-4bc1-8628-577578e13bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:17.010050 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137bf7e-4daf-4bc1-8628-577578e13bd5 None admin] PATH_INFO: `/v3/users/2e9628ad308b4fa89b70c33829d0b240` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:17.011925 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137bf7e-4daf-4bc1-8628-577578e13bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=2e9628ad308b4fa89b70c33829d0b240)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:17.013390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137bf7e-4daf-4bc1-8628-577578e13bd5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:17.015019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 582/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:01:16 2022] GET /identity/v3/users/2e9628ad308b4fa89b70c33829d0b240 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:01:17.020975 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:17.118728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9249-c227-4732-97a5-105f411ca800 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:17.152925 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9ddc7-b5de-4f64-b109-37bf72737b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:17.153621 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9ddc7-b5de-4f64-b109-37bf72737b72 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:17.153937 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9ddc7-b5de-4f64-b109-37bf72737b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:17.154248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9ddc7-b5de-4f64-b109-37bf72737b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:17.219964 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9ddc7-b5de-4f64-b109-37bf72737b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:17.221420 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9ddc7-b5de-4f64-b109-37bf72737b72 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:17.316015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 577/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:01:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:01:17.322137 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137bf7e-4daf-4bc1-8628-577578e13bd5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:17.424817 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137bf7e-4daf-4bc1-8628-577578e13bd5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:17.462123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb78bc-9040-4339-b89d-49242cb7ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:17.462979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb78bc-9040-4339-b89d-49242cb7ed0a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:17.463254 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb78bc-9040-4339-b89d-49242cb7ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:17.463522 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb78bc-9040-4339-b89d-49242cb7ed0a None admin] PATH_INFO: `/v3/projects/7e4555dad3094fedb0cf0edb96328d8e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:17.465046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb78bc-9040-4339-b89d-49242cb7ed0a None admin] RBAC: Authorizing `identity:get_project(project_id=7e4555dad3094fedb0cf0edb96328d8e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:17.466359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb78bc-9040-4339-b89d-49242cb7ed0a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:17.468101 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 583/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:01:17 2022] GET /identity/v3/projects/7e4555dad3094fedb0cf0edb96328d8e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:17.474369 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9ddc7-b5de-4f64-b109-37bf72737b72 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:17.570619 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9ddc7-b5de-4f64-b109-37bf72737b72 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:17.604014 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddf372-b09c-4375-970c-4c33309bac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:17.605469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddf372-b09c-4375-970c-4c33309bac27 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:17.605977 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddf372-b09c-4375-970c-4c33309bac27 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:17.606265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddf372-b09c-4375-970c-4c33309bac27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:17.607105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddf372-b09c-4375-970c-4c33309bac27 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=7e4555dad3094fedb0cf0edb96328d8e, user.id=2e9628ad308b4fa89b70c33829d0b240) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:17.607417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddf372-b09c-4375-970c-4c33309bac27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:17.609136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddf372-b09c-4375-970c-4c33309bac27 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:17.615366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 578/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:01:17 2022] GET /identity/v3/role_assignments?user.id=2e9628ad308b4fa89b70c33829d0b240&scope.project.id=7e4555dad3094fedb0cf0edb96328d8e&role.id=52bf3a299728408b8384e30e08547fd8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:20.013927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49884293-aed5-4703-93d6-ddaf3a10cc4b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:20.014800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49884293-aed5-4703-93d6-ddaf3a10cc4b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:20.014965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49884293-aed5-4703-93d6-ddaf3a10cc4b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:20.016360 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 584/1162] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:01:20.022257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35650797-36e1-41bc-ae12-d07515068adc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:20.022831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35650797-36e1-41bc-ae12-d07515068adc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:20.022831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35650797-36e1-41bc-ae12-d07515068adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:20.039834 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-35650797-36e1-41bc-ae12-d07515068adc None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:20.041059 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-35650797-36e1-41bc-ae12-d07515068adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:20.127372 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 579/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:01:20.151184 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49884293-aed5-4703-93d6-ddaf3a10cc4b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:20.275720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49884293-aed5-4703-93d6-ddaf3a10cc4b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:20.317204 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0c2c-33cc-479d-a1da-e85267fc411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:20.318124 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0c2c-33cc-479d-a1da-e85267fc411e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:20.318544 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0c2c-33cc-479d-a1da-e85267fc411e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:20.318951 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0c2c-33cc-479d-a1da-e85267fc411e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:20.397856 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0c2c-33cc-479d-a1da-e85267fc411e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:20.399317 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0c2c-33cc-479d-a1da-e85267fc411e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:20.502891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 585/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:01:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:01:20.511927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35650797-36e1-41bc-ae12-d07515068adc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:20.622472 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35650797-36e1-41bc-ae12-d07515068adc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:20.658526 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251a888-757a-41e3-8575-137c4d081875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:20.659328 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251a888-757a-41e3-8575-137c4d081875 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:20.659612 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251a888-757a-41e3-8575-137c4d081875 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:20.659877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251a888-757a-41e3-8575-137c4d081875 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:20.667411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251a888-757a-41e3-8575-137c4d081875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:20.668941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251a888-757a-41e3-8575-137c4d081875 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2251a888-757a-41e3-8575-137c4d081875 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:01:20.684449 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:01:20.686424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:01:20.688435 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 580/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:01:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:01:20.693957 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0c2c-33cc-479d-a1da-e85267fc411e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:20.790730 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0c2c-33cc-479d-a1da-e85267fc411e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:20.824774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e498c3d-e494-4958-838e-6b2d56998437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:20.825441 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498c3d-e494-4958-838e-6b2d56998437 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:20.825711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498c3d-e494-4958-838e-6b2d56998437 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:20.825976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498c3d-e494-4958-838e-6b2d56998437 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:20.826696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e498c3d-e494-4958-838e-6b2d56998437 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:20.826984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e498c3d-e494-4958-838e-6b2d56998437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:20.828359 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e498c3d-e494-4958-838e-6b2d56998437 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:20.835946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 586/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 14:01:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:23.118327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93b97-8af3-4305-87cf-078f46283daf None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:23.118876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93b97-8af3-4305-87cf-078f46283daf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:23.118876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93b97-8af3-4305-87cf-078f46283daf None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:23.120227 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 581/1167] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:23.126536 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333ab88-a166-47f5-9657-49d8d757ec5c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:23.127053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333ab88-a166-47f5-9657-49d8d757ec5c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:23.127183 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333ab88-a166-47f5-9657-49d8d757ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:23.145909 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4333ab88-a166-47f5-9657-49d8d757ec5c None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:23.147112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4333ab88-a166-47f5-9657-49d8d757ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:23.215931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 587/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:01:23.239556 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a93b97-8af3-4305-87cf-078f46283daf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:23.340688 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a93b97-8af3-4305-87cf-078f46283daf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:23.373308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06607a3f-c5fe-4e1e-a8d8-48919fbf657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:23.373961 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607a3f-c5fe-4e1e-a8d8-48919fbf657f None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:23.374239 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607a3f-c5fe-4e1e-a8d8-48919fbf657f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:23.374514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607a3f-c5fe-4e1e-a8d8-48919fbf657f None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:23.375252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607a3f-c5fe-4e1e-a8d8-48919fbf657f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:23.376616 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607a3f-c5fe-4e1e-a8d8-48919fbf657f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:23.392052 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 582/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Mon May 16 14:01:23 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:01:25.723973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c2e9d-7c77-42ae-8728-0689decee65d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:25.724589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c2e9d-7c77-42ae-8728-0689decee65d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:25.724789 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c2e9d-7c77-42ae-8728-0689decee65d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:25.726413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 588/1170] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:25.733471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac8cc-2f7d-4f9a-9e03-9c7d2e57ee47 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:25.734065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac8cc-2f7d-4f9a-9e03-9c7d2e57ee47 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:25.734065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ac8cc-2f7d-4f9a-9e03-9c7d2e57ee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:25.753139 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2c8ac8cc-2f7d-4f9a-9e03-9c7d2e57ee47 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:25.754392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2c8ac8cc-2f7d-4f9a-9e03-9c7d2e57ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:25.825890 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 583/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:25.850535 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c2e9d-7c77-42ae-8728-0689decee65d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:25.957280 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c2e9d-7c77-42ae-8728-0689decee65d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:25.998339 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbed52-609c-450f-b864-405dd1646076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:25.999131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbed52-609c-450f-b864-405dd1646076 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:25.999416 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbed52-609c-450f-b864-405dd1646076 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:25.999693 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbed52-609c-450f-b864-405dd1646076 None admin] PATH_INFO: `/v3/domains/38ca4143add64f2bbbcc316bb3599fa1` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:26.011038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbed52-609c-450f-b864-405dd1646076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=38ca4143add64f2bbbcc316bb3599fa1)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:26.013188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbed52-609c-450f-b864-405dd1646076 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:26.014936 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 589/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Mon May 16 14:01:25 2022] GET /identity/v3/domains/38ca4143add64f2bbbcc316bb3599fa1 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:26.021172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac8cc-2f7d-4f9a-9e03-9c7d2e57ee47 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:26.117317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ac8cc-2f7d-4f9a-9e03-9c7d2e57ee47 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:26.151596 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f290-d930-4893-bfa1-4552b1c42e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:26.153511 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f290-d930-4893-bfa1-4552b1c42e9c None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:26.153800 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f290-d930-4893-bfa1-4552b1c42e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:26.155380 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f290-d930-4893-bfa1-4552b1c42e9c None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:26.156113 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0f290-d930-4893-bfa1-4552b1c42e9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:26.157579 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0f290-d930-4893-bfa1-4552b1c42e9c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:26.183482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 584/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:01:26 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:01:28.514441 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81278e88-7e2d-4a4d-9cc4-7155ad027b90 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:28.515005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81278e88-7e2d-4a4d-9cc4-7155ad027b90 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:28.515005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81278e88-7e2d-4a4d-9cc4-7155ad027b90 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:28.516334 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 590/1174] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:28.522003 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166c65-873c-427c-8ab2-140cee0482d3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:28.522494 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166c65-873c-427c-8ab2-140cee0482d3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:28.522628 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166c65-873c-427c-8ab2-140cee0482d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:28.539837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-73166c65-873c-427c-8ab2-140cee0482d3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:28.541082 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-73166c65-873c-427c-8ab2-140cee0482d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:28.606980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 585/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:28.632641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81278e88-7e2d-4a4d-9cc4-7155ad027b90 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:28.741211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81278e88-7e2d-4a4d-9cc4-7155ad027b90 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:28.779006 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0dfca-cd25-493d-a5ba-b35a61c4fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:28.779770 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0dfca-cd25-493d-a5ba-b35a61c4fc6b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:28.780051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0dfca-cd25-493d-a5ba-b35a61c4fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:28.780317 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0dfca-cd25-493d-a5ba-b35a61c4fc6b None admin] PATH_INFO: `/v3/domains/38ca4143add64f2bbbcc316bb3599fa1` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:28.781534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0dfca-cd25-493d-a5ba-b35a61c4fc6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=38ca4143add64f2bbbcc316bb3599fa1)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:28.782962 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0dfca-cd25-493d-a5ba-b35a61c4fc6b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:28.784559 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 591/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Mon May 16 14:01:28 2022] GET /identity/v3/domains/38ca4143add64f2bbbcc316bb3599fa1 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:28.790424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166c65-873c-427c-8ab2-140cee0482d3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:28.888478 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166c65-873c-427c-8ab2-140cee0482d3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:28.923561 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18adb0-c9bc-46b5-9afc-6292d737e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:28.924236 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18adb0-c9bc-46b5-9afc-6292d737e884 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:28.924514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18adb0-c9bc-46b5-9afc-6292d737e884 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:28.924825 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18adb0-c9bc-46b5-9afc-6292d737e884 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:28.925534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18adb0-c9bc-46b5-9afc-6292d737e884 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:28.926967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18adb0-c9bc-46b5-9afc-6292d737e884 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:28.949034 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 586/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 14:01:28 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:01:31.326120 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44871f-cbb5-45fe-a109-1f57f311f58b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:31.326655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44871f-cbb5-45fe-a109-1f57f311f58b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:31.326655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44871f-cbb5-45fe-a109-1f57f311f58b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:31.328022 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 592/1178] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:31.333714 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3404-26b8-4c46-b222-bdef2329c514 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:31.334172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3404-26b8-4c46-b222-bdef2329c514 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:31.334266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3404-26b8-4c46-b222-bdef2329c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:31.351976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c34a3404-26b8-4c46-b222-bdef2329c514 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:31.353194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c34a3404-26b8-4c46-b222-bdef2329c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:31.418668 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 587/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:31.442272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44871f-cbb5-45fe-a109-1f57f311f58b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:31.542147 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44871f-cbb5-45fe-a109-1f57f311f58b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:31.575145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ee0a-d2f9-462f-b2ae-73578a426946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:31.575923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ee0a-d2f9-462f-b2ae-73578a426946 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:31.576248 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ee0a-d2f9-462f-b2ae-73578a426946 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:31.576459 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ee0a-d2f9-462f-b2ae-73578a426946 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:31.586646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53ee0a-d2f9-462f-b2ae-73578a426946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5a53ee0a-d2f9-462f-b2ae-73578a426946 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:01:31.594857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:01:31.596723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:01:31.598362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 593/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:01:31.602318 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a3404-26b8-4c46-b222-bdef2329c514 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:31.705812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a3404-26b8-4c46-b222-bdef2329c514 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:31.738106 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:31.738772 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:31.739048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:31.739317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:31.740058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:31.740354 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:31.741777 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:31.750676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 588/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:31.757748 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ee0a-d2f9-462f-b2ae-73578a426946 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:31.857234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ee0a-d2f9-462f-b2ae-73578a426946 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:31.890455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21033-bc66-4962-a243-50c9e5c62355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:31.891324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21033-bc66-4962-a243-50c9e5c62355 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:31.891604 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21033-bc66-4962-a243-50c9e5c62355 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:31.891873 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21033-bc66-4962-a243-50c9e5c62355 None admin] PATH_INFO: `/v3/users/a3fa9077dac9450ba4c528c72c32f46e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:31.906107 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec21033-bc66-4962-a243-50c9e5c62355 None admin] RBAC: Authorizing `identity:get_user(user_id=a3fa9077dac9450ba4c528c72c32f46e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:31.907649 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec21033-bc66-4962-a243-50c9e5c62355 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:31.909493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 594/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:01:31 2022] GET /identity/v3/users/a3fa9077dac9450ba4c528c72c32f46e => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:31.915940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:32.013005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e051-86ce-49cc-bcee-d29d482e7b8b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:32.047246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c7f59-f490-4d4c-84dd-fcc36919bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:32.047891 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7f59-f490-4d4c-84dd-fcc36919bc25 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:32.048171 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7f59-f490-4d4c-84dd-fcc36919bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:32.048464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7f59-f490-4d4c-84dd-fcc36919bc25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:32.113375 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c7f59-f490-4d4c-84dd-fcc36919bc25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:32.114726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c7f59-f490-4d4c-84dd-fcc36919bc25 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:32.212342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 589/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:01:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:01:32.218696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21033-bc66-4962-a243-50c9e5c62355 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:32.318315 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21033-bc66-4962-a243-50c9e5c62355 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:32.352411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d26cc3-2c9d-4ea9-b0bb-6ca4d9bd2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:32.353304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26cc3-2c9d-4ea9-b0bb-6ca4d9bd2883 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:32.353583 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26cc3-2c9d-4ea9-b0bb-6ca4d9bd2883 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:32.353853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26cc3-2c9d-4ea9-b0bb-6ca4d9bd2883 None admin] PATH_INFO: `/v3/projects/d52abdb5df324666a7e8da481dc52eeb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:32.355032 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d26cc3-2c9d-4ea9-b0bb-6ca4d9bd2883 None admin] RBAC: Authorizing `identity:get_project(project_id=d52abdb5df324666a7e8da481dc52eeb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:32.356492 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d26cc3-2c9d-4ea9-b0bb-6ca4d9bd2883 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:32.358221 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 595/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:01:32 2022] GET /identity/v3/projects/d52abdb5df324666a7e8da481dc52eeb => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:32.364810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c7f59-f490-4d4c-84dd-fcc36919bc25 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:32.464533 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c7f59-f490-4d4c-84dd-fcc36919bc25 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:32.501086 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b10d5c-5adf-4f1a-8bbe-754b0bb4315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:32.501747 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10d5c-5adf-4f1a-8bbe-754b0bb4315a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:32.502030 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10d5c-5adf-4f1a-8bbe-754b0bb4315a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:32.502305 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10d5c-5adf-4f1a-8bbe-754b0bb4315a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:32.503131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b10d5c-5adf-4f1a-8bbe-754b0bb4315a None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=d52abdb5df324666a7e8da481dc52eeb, user.id=a3fa9077dac9450ba4c528c72c32f46e) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:32.503444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b10d5c-5adf-4f1a-8bbe-754b0bb4315a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:32.504879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b10d5c-5adf-4f1a-8bbe-754b0bb4315a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:32.510412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 590/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:01:32 2022] GET /identity/v3/role_assignments?user.id=a3fa9077dac9450ba4c528c72c32f46e&scope.project.id=d52abdb5df324666a7e8da481dc52eeb&role.id=52bf3a299728408b8384e30e08547fd8 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:34.840573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e5b1-c27b-4531-9358-70a17dc5f4d2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:34.841151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e5b1-c27b-4531-9358-70a17dc5f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:34.841151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e5b1-c27b-4531-9358-70a17dc5f4d2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:34.842500 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 596/1186] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:34.852114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15cb54-c83d-4b38-833b-22d9b61b0e6a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:34.852610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15cb54-c83d-4b38-833b-22d9b61b0e6a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:34.852728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15cb54-c83d-4b38-833b-22d9b61b0e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:34.875048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2b15cb54-c83d-4b38-833b-22d9b61b0e6a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:34.877101 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2b15cb54-c83d-4b38-833b-22d9b61b0e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:34.983525 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 591/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:35.006938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e5b1-c27b-4531-9358-70a17dc5f4d2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:35.108898 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e5b1-c27b-4531-9358-70a17dc5f4d2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:35.144121 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e29214-a40b-4464-80e5-c691b1aaff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:35.144952 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e29214-a40b-4464-80e5-c691b1aaff94 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:35.145234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e29214-a40b-4464-80e5-c691b1aaff94 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:35.145507 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e29214-a40b-4464-80e5-c691b1aaff94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:35.157808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e29214-a40b-4464-80e5-c691b1aaff94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-61e29214-a40b-4464-80e5-c691b1aaff94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:01:35.165738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:01:35.166940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:01:35.167926 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 597/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:01:35.174464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15cb54-c83d-4b38-833b-22d9b61b0e6a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:35.290412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15cb54-c83d-4b38-833b-22d9b61b0e6a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:35.345187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:35.345875 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:35.346154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:35.346427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:35.347188 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:35.347491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:35.348903 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:35.358152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 592/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:35.364562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e29214-a40b-4464-80e5-c691b1aaff94 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:35.464809 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e29214-a40b-4464-80e5-c691b1aaff94 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:35.498629 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a47bc-28db-4b03-b82c-434a3e9137f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:35.499502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a47bc-28db-4b03-b82c-434a3e9137f2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:35.499782 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a47bc-28db-4b03-b82c-434a3e9137f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:35.500054 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a47bc-28db-4b03-b82c-434a3e9137f2 None admin] PATH_INFO: `/v3/users/a3fa9077dac9450ba4c528c72c32f46e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:35.501265 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a47bc-28db-4b03-b82c-434a3e9137f2 None admin] RBAC: Authorizing `identity:get_user(user_id=a3fa9077dac9450ba4c528c72c32f46e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:35.502695 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a47bc-28db-4b03-b82c-434a3e9137f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:35.504313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 598/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:01:35 2022] GET /identity/v3/users/a3fa9077dac9450ba4c528c72c32f46e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:01:35.510375 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:35.617431 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ea83-18db-449c-aa75-0e977aaed71b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:35.650932 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf786a-7d07-44d4-a7e8-30ba0c52c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:35.651783 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf786a-7d07-44d4-a7e8-30ba0c52c487 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:35.652062 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf786a-7d07-44d4-a7e8-30ba0c52c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:35.652332 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf786a-7d07-44d4-a7e8-30ba0c52c487 None admin] PATH_INFO: `/v3/projects/d52abdb5df324666a7e8da481dc52eeb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:35.654148 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf786a-7d07-44d4-a7e8-30ba0c52c487 None admin] RBAC: Authorizing `identity:get_project(project_id=d52abdb5df324666a7e8da481dc52eeb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:35.655557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf786a-7d07-44d4-a7e8-30ba0c52c487 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:35.657308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 593/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:01:35 2022] GET /identity/v3/projects/d52abdb5df324666a7e8da481dc52eeb => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:35.663301 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a47bc-28db-4b03-b82c-434a3e9137f2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:35.766153 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a47bc-28db-4b03-b82c-434a3e9137f2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:35.798229 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb6828-c18f-42a8-a487-79c2fc4d117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:35.799112 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb6828-c18f-42a8-a487-79c2fc4d117e None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:35.799391 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb6828-c18f-42a8-a487-79c2fc4d117e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:35.799662 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb6828-c18f-42a8-a487-79c2fc4d117e None admin] PATH_INFO: `/v3/projects/d52abdb5df324666a7e8da481dc52eeb/users/a3fa9077dac9450ba4c528c72c32f46e/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:35.801619 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb6828-c18f-42a8-a487-79c2fc4d117e None admin] RBAC: Authorizing `identity:create_grant(project_id=d52abdb5df324666a7e8da481dc52eeb, user_id=a3fa9077dac9450ba4c528c72c32f46e, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:35.803041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb6828-c18f-42a8-a487-79c2fc4d117e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:35.816917 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 599/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:01:35 2022] PUT /identity/v3/projects/d52abdb5df324666a7e8da481dc52eeb/users/a3fa9077dac9450ba4c528c72c32f46e/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:01:38.117312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204fe44-2858-4b10-b604-eafd9d0ba6ed None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:38.117841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204fe44-2858-4b10-b604-eafd9d0ba6ed None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:38.118053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204fe44-2858-4b10-b604-eafd9d0ba6ed None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:38.119992 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 594/1193] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:01:38.126333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af6a0-1477-4baf-a28d-345aa9a5481d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:38.126792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af6a0-1477-4baf-a28d-345aa9a5481d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:38.126889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af6a0-1477-4baf-a28d-345aa9a5481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:38.144606 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-262af6a0-1477-4baf-a28d-345aa9a5481d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:01:38.145845 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-262af6a0-1477-4baf-a28d-345aa9a5481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:01:38.213235 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 600/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:01:38.237927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204fe44-2858-4b10-b604-eafd9d0ba6ed None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:38.342404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204fe44-2858-4b10-b604-eafd9d0ba6ed None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:38.379905 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216102f-73b3-4f5b-a4d1-223c02cb0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:38.380657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216102f-73b3-4f5b-a4d1-223c02cb0d76 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:38.380983 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216102f-73b3-4f5b-a4d1-223c02cb0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:38.381251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216102f-73b3-4f5b-a4d1-223c02cb0d76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:38.392076 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216102f-73b3-4f5b-a4d1-223c02cb0d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9216102f-73b3-4f5b-a4d1-223c02cb0d76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:01:38.399883 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:01:38.401065 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:01:38.402058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 595/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:01:38.411036 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af6a0-1477-4baf-a28d-345aa9a5481d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:38.528956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af6a0-1477-4baf-a28d-345aa9a5481d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:38.562950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:38.563620 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:38.563901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:38.564173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:38.564951 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:38.565253 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:38.566628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:38.574900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 601/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:38.581157 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216102f-73b3-4f5b-a4d1-223c02cb0d76 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:38.681468 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216102f-73b3-4f5b-a4d1-223c02cb0d76 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:38.724215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26857f-0f6d-41e0-8209-3c57e2388c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:38.725131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26857f-0f6d-41e0-8209-3c57e2388c24 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:38.725411 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26857f-0f6d-41e0-8209-3c57e2388c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:38.725685 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26857f-0f6d-41e0-8209-3c57e2388c24 None admin] PATH_INFO: `/v3/users/a3fa9077dac9450ba4c528c72c32f46e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:38.726906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26857f-0f6d-41e0-8209-3c57e2388c24 None admin] RBAC: Authorizing `identity:get_user(user_id=a3fa9077dac9450ba4c528c72c32f46e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:38.728361 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26857f-0f6d-41e0-8209-3c57e2388c24 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:38.730074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 596/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 14:01:38 2022] GET /identity/v3/users/a3fa9077dac9450ba4c528c72c32f46e => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:01:38.737620 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:38.838367 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f49e-b51d-468f-b1ed-dc0d808b6b4e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:38.871329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d531-ad31-446e-97fc-ba9e2063ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:38.872501 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d531-ad31-446e-97fc-ba9e2063ba15 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:38.872783 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d531-ad31-446e-97fc-ba9e2063ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:38.873057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d531-ad31-446e-97fc-ba9e2063ba15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:38.938085 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631d531-ad31-446e-97fc-ba9e2063ba15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:38.939587 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631d531-ad31-446e-97fc-ba9e2063ba15 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:39.035503 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 602/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:01:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:01:39.041665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26857f-0f6d-41e0-8209-3c57e2388c24 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:39.140987 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26857f-0f6d-41e0-8209-3c57e2388c24 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:39.176072 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578edf7-54ce-44eb-960e-3e1ed0492a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:39.176970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578edf7-54ce-44eb-960e-3e1ed0492a8e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:39.177252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578edf7-54ce-44eb-960e-3e1ed0492a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:39.177528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578edf7-54ce-44eb-960e-3e1ed0492a8e None admin] PATH_INFO: `/v3/projects/d52abdb5df324666a7e8da481dc52eeb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:39.178715 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578edf7-54ce-44eb-960e-3e1ed0492a8e None admin] RBAC: Authorizing `identity:get_project(project_id=d52abdb5df324666a7e8da481dc52eeb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:39.180221 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578edf7-54ce-44eb-960e-3e1ed0492a8e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:39.181909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 597/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 14:01:39 2022] GET /identity/v3/projects/d52abdb5df324666a7e8da481dc52eeb => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:01:39.188955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d531-ad31-446e-97fc-ba9e2063ba15 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:01:39.290853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d531-ad31-446e-97fc-ba9e2063ba15 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:01:39.324455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a54b0-e09c-4616-8b30-ec97be1d8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:01:39.325709 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a54b0-e09c-4616-8b30-ec97be1d8439 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:01:39.326171 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a54b0-e09c-4616-8b30-ec97be1d8439 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:01:39.326288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a54b0-e09c-4616-8b30-ec97be1d8439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:01:39.327051 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a54b0-e09c-4616-8b30-ec97be1d8439 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=d52abdb5df324666a7e8da481dc52eeb, user.id=a3fa9077dac9450ba4c528c72c32f46e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:01:39.327352 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a54b0-e09c-4616-8b30-ec97be1d8439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:01:39.328819 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a54b0-e09c-4616-8b30-ec97be1d8439 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:01:39.335906 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 603/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:01:39 2022] GET /identity/v3/role_assignments?user.id=a3fa9077dac9450ba4c528c72c32f46e&scope.project.id=d52abdb5df324666a7e8da481dc52eeb&role.id=52bf3a299728408b8384e30e08547fd8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:41.859876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03cb75-8962-42cf-bce4-89629d34f2c4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:41.860482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03cb75-8962-42cf-bce4-89629d34f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:41.860482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03cb75-8962-42cf-bce4-89629d34f2c4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:41.863391 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 598/1201] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:02:41.869821 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2e4e-279b-4621-922d-82a9a11bf24d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:41.870397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2e4e-279b-4621-922d-82a9a11bf24d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:41.870397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2e4e-279b-4621-922d-82a9a11bf24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:41.889542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e78c2e4e-279b-4621-922d-82a9a11bf24d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:02:41.891181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e78c2e4e-279b-4621-922d-82a9a11bf24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:02:41.979210 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 604/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:02:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:02:42.006137 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03cb75-8962-42cf-bce4-89629d34f2c4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:42.134426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03cb75-8962-42cf-bce4-89629d34f2c4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:42.177395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:42.178251 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:42.178543 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:42.178861 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:42.190464 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:42.192115 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:02:42.211442 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:42.212868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:42.213844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:02:42.213844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:02:42.213844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:42.213844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:02:42.213844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 599/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:42.219196 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2e4e-279b-4621-922d-82a9a11bf24d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:42.350714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2e4e-279b-4621-922d-82a9a11bf24d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:42.392020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34f488-f60c-4524-afa6-bd5e74865db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:42.392616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f488-f60c-4524-afa6-bd5e74865db5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:42.393082 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f488-f60c-4524-afa6-bd5e74865db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:42.393522 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f488-f60c-4524-afa6-bd5e74865db5 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:42.394347 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f488-f60c-4524-afa6-bd5e74865db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:42.394641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f488-f60c-4524-afa6-bd5e74865db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:42.396071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f488-f60c-4524-afa6-bd5e74865db5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:42.414385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 605/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:42.415689 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:42.529450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f948a9-c6dc-4b03-a325-54b98d829a2f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:42.569303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcb336-aaf0-43d9-9d11-daa74fca72ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:42.570086 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb336-aaf0-43d9-9d11-daa74fca72ae None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:42.570402 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb336-aaf0-43d9-9d11-daa74fca72ae None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:42.570675 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb336-aaf0-43d9-9d11-daa74fca72ae None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:42.571507 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcb336-aaf0-43d9-9d11-daa74fca72ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:42.573359 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcb336-aaf0-43d9-9d11-daa74fca72ae None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:42.605583 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 600/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 14:02:42 2022] POST /identity/v3/users => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:02:45.174255 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76751bd4-8046-426a-b17d-828a55857ea9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:45.175385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76751bd4-8046-426a-b17d-828a55857ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:45.175385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76751bd4-8046-426a-b17d-828a55857ea9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:45.177324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 606/1206] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:02:45.183807 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f4d2-99fe-47d0-9568-c5d630241a22 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:45.184391 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f4d2-99fe-47d0-9568-c5d630241a22 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:45.184505 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f4d2-99fe-47d0-9568-c5d630241a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:45.203622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-31d5f4d2-99fe-47d0-9568-c5d630241a22 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:02:45.204947 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-31d5f4d2-99fe-47d0-9568-c5d630241a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:02:45.287283 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 601/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:02:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:02:45.312837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76751bd4-8046-426a-b17d-828a55857ea9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:45.446294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76751bd4-8046-426a-b17d-828a55857ea9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:45.488873 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81be2-99b5-4f1e-829f-0ef9c4b683f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:45.489817 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81be2-99b5-4f1e-829f-0ef9c4b683f5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:45.490115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81be2-99b5-4f1e-829f-0ef9c4b683f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:45.490432 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81be2-99b5-4f1e-829f-0ef9c4b683f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:45.505796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81be2-99b5-4f1e-829f-0ef9c4b683f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-49e81be2-99b5-4f1e-829f-0ef9c4b683f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:02:45.514277 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:45.515594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:45.521712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 607/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 14:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:45.528030 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f4d2-99fe-47d0-9568-c5d630241a22 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:45.652213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f4d2-99fe-47d0-9568-c5d630241a22 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:45.693876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:45.694577 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:45.694882 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:45.695128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:45.695989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:45.696359 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:45.698027 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:45.712186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 602/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 14:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:02:45.713619 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81be2-99b5-4f1e-829f-0ef9c4b683f5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:45.827918 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81be2-99b5-4f1e-829f-0ef9c4b683f5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:45.869284 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:45.870129 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:45.870408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:45.870678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:45.881618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:45.883084 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:02:45.903047 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:45.904155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:45.905719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:02:45.905719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:02:45.905719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:45.905719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:45.905719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 608/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:02:45.910260 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:46.031632 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e685-65d1-407c-87c7-dfbe5162666a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:46.072644 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:46.073650 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:46.073973 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:46.074289 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:46.075073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:46.075370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:46.076929 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:46.091307 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 603/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:46.098776 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:46.219971 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f05ba-e814-42fa-9053-24855cf15700 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:46.266130 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:46.267129 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:46.267488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:46.267774 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:46.278950 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:46.280582 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:02:46.298974 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:46.300464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:46.301670 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 609/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:46.306629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:46.426241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1432d0-2657-4998-8ae0-6eed413dd140 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:46.468248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:46.469122 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:46.469501 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:46.469879 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:46.470813 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:46.471215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:46.473288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:46.494733 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 604/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 14:02:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:46.500938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:46.619123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf7523-205e-45ed-998f-e91758203bca None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:46.662786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c00fa-34f9-4e43-9347-3fd253abcef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:46.663496 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c00fa-34f9-4e43-9347-3fd253abcef5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:46.663777 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c00fa-34f9-4e43-9347-3fd253abcef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:46.664050 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c00fa-34f9-4e43-9347-3fd253abcef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:46.749915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c00fa-34f9-4e43-9347-3fd253abcef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:46.751825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c00fa-34f9-4e43-9347-3fd253abcef5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:46.865770 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 610/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:02:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:02:46.874258 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:46.985938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b3e1-8120-4226-8d01-badeda23d677 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:47.022928 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:47.023726 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:47.024068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:47.024345 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:47.035469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:47.037293 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:02:47.057252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:47.058532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:47.059655 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:02:47.059655 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:02:47.059655 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:47.059655 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:02:47.064709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 605/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:47.064891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c00fa-34f9-4e43-9347-3fd253abcef5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:47.180162 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c00fa-34f9-4e43-9347-3fd253abcef5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:47.220107 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:47.224030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:47.224030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:47.224030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:47.224030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:47.224030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:47.224755 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:47.236958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 611/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:47.243934 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:47.348842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c9fc-1de8-460d-b916-70a8fbcbf2bc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:47.382035 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:47.382828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:47.383105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:47.383378 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:47.390545 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:47.392164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:02:47.406627 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:47.407817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:47.409011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:02:47.409011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:02:47.409011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:02:47.409011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:02:47.409011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:02:47.409011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:02:47.409011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:02:47.409011 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:02:47.413246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 606/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:47.414470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:47.529455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780be07-7774-429a-81fe-19b71e0d4ad2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:47.569151 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1adae0-3372-41fb-9d9f-ee0a096334a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:47.569857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1adae0-3372-41fb-9d9f-ee0a096334a1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:47.570123 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1adae0-3372-41fb-9d9f-ee0a096334a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:47.570385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1adae0-3372-41fb-9d9f-ee0a096334a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:47.571190 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1adae0-3372-41fb-9d9f-ee0a096334a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:47.571493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1adae0-3372-41fb-9d9f-ee0a096334a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:47.573001 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1adae0-3372-41fb-9d9f-ee0a096334a1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:47.587142 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 612/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:47.593664 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:47.712412 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2959e6-df3e-451b-b7cd-1135f9a9bbd8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:47.747754 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10796068-b185-4787-ba7e-1c8241b83baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:47.748753 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10796068-b185-4787-ba7e-1c8241b83baf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:47.749198 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10796068-b185-4787-ba7e-1c8241b83baf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:47.749609 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10796068-b185-4787-ba7e-1c8241b83baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:47.750661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10796068-b185-4787-ba7e-1c8241b83baf None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=a758fc0f31ca40db96d0625dbb5d4c0e) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:47.751145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10796068-b185-4787-ba7e-1c8241b83baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:47.753195 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10796068-b185-4787-ba7e-1c8241b83baf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:47.759683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 607/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:02:47 2022] GET /identity/v3/role_assignments?user.id=a758fc0f31ca40db96d0625dbb5d4c0e&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:50.052049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724e4c-0cb5-4ee8-83ec-44dd50315473 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:50.052604 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724e4c-0cb5-4ee8-83ec-44dd50315473 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:50.052604 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724e4c-0cb5-4ee8-83ec-44dd50315473 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:50.054139 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 613/1220] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:02:50.059590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d8bd-7800-457c-9bad-69880d95b5d0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:50.060058 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d8bd-7800-457c-9bad-69880d95b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:50.060138 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d8bd-7800-457c-9bad-69880d95b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:50.077086 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5af0d8bd-7800-457c-9bad-69880d95b5d0 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:02:50.078285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5af0d8bd-7800-457c-9bad-69880d95b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:02:50.151318 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 608/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:02:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:02:50.175327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b724e4c-0cb5-4ee8-83ec-44dd50315473 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:50.291568 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b724e4c-0cb5-4ee8-83ec-44dd50315473 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:50.332133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453145a-e5bd-48e3-a279-eae78d80fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:50.332991 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453145a-e5bd-48e3-a279-eae78d80fb4b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:50.333290 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453145a-e5bd-48e3-a279-eae78d80fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:50.333561 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453145a-e5bd-48e3-a279-eae78d80fb4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:50.344745 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453145a-e5bd-48e3-a279-eae78d80fb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2453145a-e5bd-48e3-a279-eae78d80fb4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:02:50.353141 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:50.354493 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:50.355697 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 614/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 14:02:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:50.363312 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d8bd-7800-457c-9bad-69880d95b5d0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:50.491423 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d8bd-7800-457c-9bad-69880d95b5d0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:50.533831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:50.535605 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:50.536215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:50.536797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:50.537953 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:50.538311 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:50.540567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:50.549565 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 609/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 14:02:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:50.555735 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453145a-e5bd-48e3-a279-eae78d80fb4b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:50.678327 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453145a-e5bd-48e3-a279-eae78d80fb4b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:50.715603 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:50.716403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:50.716695 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:50.716976 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:50.729067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:50.730804 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:02:50.749955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:50.750885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:50.751796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:02:50.751796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:02:50.751796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:50.751796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:50.751796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 615/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:50.758152 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:50.859783 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f3b77-5a6b-419a-8add-d6db7e588e6c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:50.897673 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:50.898415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:50.898798 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:50.899111 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:50.899951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:50.900295 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:50.901897 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:50.917416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 610/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:50.923042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:51.030509 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ec9b-6989-43f4-bbbe-81966d6b97fc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:51.067181 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:51.068070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:51.068403 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:51.068784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:51.077755 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:51.079395 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:02:51.096292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:51.097646 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:51.098828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 616/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:51.103872 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:51.209959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c17ce-19d0-4816-89f8-e6a939887b75 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:51.248511 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:51.249246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:51.249596 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:51.249812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:51.250762 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:51.251095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:51.252729 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:51.272651 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 611/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 14:02:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:51.278810 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:51.391350 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b48bd-243a-485c-b030-88a68aa698a3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:51.427378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:51.428175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:51.428480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:51.428770 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:51.440080 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:51.441669 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:02:51.460767 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:51.462093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:51.463251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:02:51.463251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:02:51.463251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:51.463251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:51.463251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 617/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:51.468337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:51.580154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f34f-373c-47e7-82db-a40001846d5f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:51.620664 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:51.621461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:51.621769 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:51.622083 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:51.622946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:51.623268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:51.624846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:51.638114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 612/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:51.645068 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:51.759939 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2beff9-a3c4-430d-b388-f940772f7e24 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:51.799680 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:51.801100 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:51.801379 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:51.801653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:51.810424 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:51.812393 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:02:51.831007 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:51.832439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:51.833438 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 618/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:02:51.838952 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:51.957057 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e319-4d55-469a-aed4-c89b5a826d1b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:51.992646 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf48846-58bd-4d75-bcb3-3394c96d50e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:51.993323 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48846-58bd-4d75-bcb3-3394c96d50e0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:51.993643 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48846-58bd-4d75-bcb3-3394c96d50e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:51.993917 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48846-58bd-4d75-bcb3-3394c96d50e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:51.994944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf48846-58bd-4d75-bcb3-3394c96d50e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:51.995246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf48846-58bd-4d75-bcb3-3394c96d50e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:51.996696 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf48846-58bd-4d75-bcb3-3394c96d50e0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:52.009682 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 613/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:52.015654 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:52.119264 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e54df-5909-4ee3-bc11-16349abe8c18 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:52.157956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72760118-3bbf-4d45-991a-554c97879eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:52.158823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760118-3bbf-4d45-991a-554c97879eac None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:52.159046 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760118-3bbf-4d45-991a-554c97879eac None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:52.159312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760118-3bbf-4d45-991a-554c97879eac None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/a758fc0f31ca40db96d0625dbb5d4c0e/roles/800436bc9e734eb38844e9544c3dc7bc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:52.176376 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72760118-3bbf-4d45-991a-554c97879eac None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=a758fc0f31ca40db96d0625dbb5d4c0e, role_id=800436bc9e734eb38844e9544c3dc7bc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:52.178341 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72760118-3bbf-4d45-991a-554c97879eac None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:52.190837 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 619/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:02:52 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/a758fc0f31ca40db96d0625dbb5d4c0e/roles/800436bc9e734eb38844e9544c3dc7bc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:02:54.479816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810d8fd-4933-448b-a664-4856734aee9a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:54.480400 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810d8fd-4933-448b-a664-4856734aee9a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:54.480400 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810d8fd-4933-448b-a664-4856734aee9a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:54.481814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 614/1233] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:02:54.487494 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80981c22-2ee4-4482-9611-6ebc5f06c9b5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:54.488508 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80981c22-2ee4-4482-9611-6ebc5f06c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:54.488701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80981c22-2ee4-4482-9611-6ebc5f06c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:54.505769 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-80981c22-2ee4-4482-9611-6ebc5f06c9b5 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:02:54.506965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-80981c22-2ee4-4482-9611-6ebc5f06c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:02:54.580510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 620/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:02:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:02:54.605582 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810d8fd-4933-448b-a664-4856734aee9a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:54.713436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810d8fd-4933-448b-a664-4856734aee9a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:54.748323 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa96c2f-8d14-4263-9911-57f3d8b4b2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:54.749164 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa96c2f-8d14-4263-9911-57f3d8b4b2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:54.749508 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa96c2f-8d14-4263-9911-57f3d8b4b2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:54.749793 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa96c2f-8d14-4263-9911-57f3d8b4b2d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:54.761711 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa96c2f-8d14-4263-9911-57f3d8b4b2d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5fa96c2f-8d14-4263-9911-57f3d8b4b2d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:02:54.770220 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:54.771852 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:02:54.773265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 615/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 14:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:54.777616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80981c22-2ee4-4482-9611-6ebc5f06c9b5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:54.885888 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80981c22-2ee4-4482-9611-6ebc5f06c9b5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:54.921412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:54.922079 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:54.922354 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:54.922625 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:54.923361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:54.923659 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:54.925054 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:54.935177 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 621/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 14:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:54.941997 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa96c2f-8d14-4263-9911-57f3d8b4b2d6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:55.049572 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa96c2f-8d14-4263-9911-57f3d8b4b2d6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:55.083708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:55.084508 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:55.084847 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:55.085128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:55.096797 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:55.099226 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:02:55.119042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:55.120460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:55.126075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:02:55.126075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:02:55.126075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:55.126075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:02:55.126075 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 616/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:55.126425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:55.234548 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c644cdc-f91d-4580-bbe0-f9ff84bda751 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:55.275016 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:55.275671 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:55.275944 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:55.276217 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:55.277081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:55.277380 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:55.278744 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:55.290855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 622/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:55.296605 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:55.406743 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd747ee9-eb38-4c26-9445-c9b09eaa8dd4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:55.442384 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:55.443215 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:55.443492 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:55.443762 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:55.451691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:55.453167 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:02:55.469235 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:55.470499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:02:55.471604 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 617/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:02:55.478828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:55.597425 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc84f8c-ad44-47c2-8605-ae5470e8fee2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:55.635244 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:55.636234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:55.636510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:55.636816 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:55.637655 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:55.637953 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:55.639476 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:55.666451 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 623/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 14:02:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:55.667672 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:55.776750 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c1039-c80f-4d88-83b1-3e7fc110a84a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:55.813573 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dacac-b39e-42b8-872d-04cb953f7603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:55.814224 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dacac-b39e-42b8-872d-04cb953f7603 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:55.814530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dacac-b39e-42b8-872d-04cb953f7603 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:55.814810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dacac-b39e-42b8-872d-04cb953f7603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:55.883353 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dacac-b39e-42b8-872d-04cb953f7603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:55.884899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dacac-b39e-42b8-872d-04cb953f7603 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:55.992707 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 618/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:02:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:02:55.999560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:56.109379 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d270d-e68e-446d-9524-42d3d03d6131 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:56.150410 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:56.151275 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:56.151650 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:56.151923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:56.164840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:56.166683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:02:56.186979 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:56.188143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:56.189113 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:02:56.189113 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:02:56.189113 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:02:56.189113 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:56.189113 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 624/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:56.194810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dacac-b39e-42b8-872d-04cb953f7603 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:56.307351 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dacac-b39e-42b8-872d-04cb953f7603 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:56.346281 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:56.346971 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:56.347249 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:56.347656 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:56.348521 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:56.348963 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:56.350568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:56.365365 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 619/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:02:56.371773 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:56.485984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b7c1-1abc-46da-b6bc-73b989a7f82a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:56.524483 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:56.525324 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:56.525603 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:56.525878 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:56.533881 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:56.536023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:02:56.553062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:56.554094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:02:56.555167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 625/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:02:56.560606 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:56.676924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253194-e85b-478c-98d1-941a3ab7d8e3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:56.714846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06103018-5c86-46bd-a751-a5077e9a2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:56.715691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103018-5c86-46bd-a751-a5077e9a2d0e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:56.716087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103018-5c86-46bd-a751-a5077e9a2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:56.716432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103018-5c86-46bd-a751-a5077e9a2d0e None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:56.717456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06103018-5c86-46bd-a751-a5077e9a2d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:56.717765 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06103018-5c86-46bd-a751-a5077e9a2d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:56.719444 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06103018-5c86-46bd-a751-a5077e9a2d0e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:56.738530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 620/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:56.739944 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:56.859456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9822-0466-4b31-97e2-07d2c5d34168 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:56.904472 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043229c-f430-471b-aef5-147f769edc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:56.904907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043229c-f430-471b-aef5-147f769edc64 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:56.905213 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043229c-f430-471b-aef5-147f769edc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:56.905512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043229c-f430-471b-aef5-147f769edc64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:56.906417 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043229c-f430-471b-aef5-147f769edc64 None admin] RBAC: Adding query filter params (role.id=800436bc9e734eb38844e9544c3dc7bc, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=a758fc0f31ca40db96d0625dbb5d4c0e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:56.906725 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043229c-f430-471b-aef5-147f769edc64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:56.908261 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043229c-f430-471b-aef5-147f769edc64 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:56.915398 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 626/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:02:56 2022] GET /identity/v3/role_assignments?user.id=a758fc0f31ca40db96d0625dbb5d4c0e&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=800436bc9e734eb38844e9544c3dc7bc => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:02:59.369648 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3531834-b44b-4827-adc3-bc91ec37eeac None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:59.370495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3531834-b44b-4827-adc3-bc91ec37eeac None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:59.370495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3531834-b44b-4827-adc3-bc91ec37eeac None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:59.371971 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 621/1247] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:02:59.377941 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a91e4-e38d-45b3-b351-a3176ada9f19 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:59.378458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a91e4-e38d-45b3-b351-a3176ada9f19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:59.378585 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a91e4-e38d-45b3-b351-a3176ada9f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:59.397333 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a25a91e4-e38d-45b3-b351-a3176ada9f19 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:02:59.398618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a25a91e4-e38d-45b3-b351-a3176ada9f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:02:59.475908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 627/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:02:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:02:59.502421 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3531834-b44b-4827-adc3-bc91ec37eeac None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:59.625134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3531834-b44b-4827-adc3-bc91ec37eeac None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:59.666907 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b933b-de20-4204-8ed1-f330547d9b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:59.667858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b933b-de20-4204-8ed1-f330547d9b79 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:59.668266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b933b-de20-4204-8ed1-f330547d9b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:59.668581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b933b-de20-4204-8ed1-f330547d9b79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:59.680340 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b933b-de20-4204-8ed1-f330547d9b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2f3b933b-de20-4204-8ed1-f330547d9b79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:02:59.688581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:02:59.689761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:02:59.690608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 622/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:02:59.697083 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a91e4-e38d-45b3-b351-a3176ada9f19 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:59.807166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a91e4-e38d-45b3-b351-a3176ada9f19 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:02:59.855173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:02:59.855920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:02:59.856445 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:02:59.856784 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:02:59.857540 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:02:59.857942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:02:59.859332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:02:59.868555 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 628/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:02:59.874895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b933b-de20-4204-8ed1-f330547d9b79 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:02:59.991106 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b933b-de20-4204-8ed1-f330547d9b79 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:00.032915 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:00.033910 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:00.034211 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:00.034523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:00.048844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:00.050532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:03:00.073497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:00.074641 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:00.075751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:03:00.075751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:03:00.075751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:00.075751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:00.075751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 623/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:03:00.081570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:00.189862 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905a89e-271b-45fc-a7b2-77987a2f660a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:00.227906 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:00.228657 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:00.229107 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:00.229636 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:00.230868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:00.231405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:00.233478 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:00.258157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 629/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:00.261201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:00.373286 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc232a4-49f5-4f3e-9147-671e65d1fbc0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:00.410944 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:00.411906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:00.412138 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:00.412408 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:00.420238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:00.421794 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:03:00.438006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:00.439135 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:00.440308 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 624/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:03:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:03:00.445714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:00.559378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2bed7-fb9d-4fef-8137-5545784cb7ba None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:00.601464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:00.602157 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:00.602431 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:00.602704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:00.603562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:00.603854 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:00.605378 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:00.632026 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 630/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 14:03:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:00.633439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:00.755163 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab00ed-b893-4743-86d3-88aa5db509a5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:00.796837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf8ff-121d-4261-af35-c622606526e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:00.797634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf8ff-121d-4261-af35-c622606526e3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:00.797915 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf8ff-121d-4261-af35-c622606526e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:00.798210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf8ff-121d-4261-af35-c622606526e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:00.871813 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf8ff-121d-4261-af35-c622606526e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:00.873325 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf8ff-121d-4261-af35-c622606526e3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:00.987287 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 625/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:03:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:03:00.994384 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:01.099242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183ce9-556c-44b8-bcac-be5e10df00f6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:01.135199 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:01.136012 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:01.136291 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:01.136570 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:01.146703 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:01.148150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:03:01.167685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:01.168935 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:01.169860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:03:01.169860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:03:01.169860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:01.169860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:01.169860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 631/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:01.175172 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf8ff-121d-4261-af35-c622606526e3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:01.283531 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf8ff-121d-4261-af35-c622606526e3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:01.321006 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:01.321741 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:01.321967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:01.322266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:01.323064 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:01.323384 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:01.324906 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:01.337691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 626/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:01.343590 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:01.454900 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6809e-a46e-4c01-a9b1-b9556ef9a873 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:01.491436 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:01.492328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:01.492616 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:01.492923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:01.500031 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:01.501507 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:03:01.517762 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:01.518891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:01.520792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 632/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:01.526083 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:01.645803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a8139-64f5-4177-932a-6cb2e44d2f45 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:01.682967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75395809-d22e-497a-885a-a2147c3fd5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:01.683644 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75395809-d22e-497a-885a-a2147c3fd5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:01.683920 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75395809-d22e-497a-885a-a2147c3fd5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:01.684187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75395809-d22e-497a-885a-a2147c3fd5c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:01.685354 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75395809-d22e-497a-885a-a2147c3fd5c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:01.685657 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75395809-d22e-497a-885a-a2147c3fd5c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:01.687105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75395809-d22e-497a-885a-a2147c3fd5c0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:01.701131 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 627/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:01.708180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:01.820435 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294feba-c2f6-4f64-a841-bb016d2e1866 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:01.856597 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4648a3-1404-4596-92b5-990d94d982e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:01.857286 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4648a3-1404-4596-92b5-990d94d982e5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:01.857563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4648a3-1404-4596-92b5-990d94d982e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:01.857833 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4648a3-1404-4596-92b5-990d94d982e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:01.858674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4648a3-1404-4596-92b5-990d94d982e5 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=a758fc0f31ca40db96d0625dbb5d4c0e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:01.858978 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4648a3-1404-4596-92b5-990d94d982e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:01.860426 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4648a3-1404-4596-92b5-990d94d982e5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:01.876708 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 633/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:03:01 2022] GET /identity/v3/role_assignments?user.id=a758fc0f31ca40db96d0625dbb5d4c0e&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=52bf3a299728408b8384e30e08547fd8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:04.111686 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c71b-2f07-4188-a0ad-4ff43c3392e8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:04.112209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c71b-2f07-4188-a0ad-4ff43c3392e8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:04.112209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c71b-2f07-4188-a0ad-4ff43c3392e8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:04.113630 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 628/1261] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:03:04.118940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515aa86-e722-4aa1-a17f-f670de028b0d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:04.119351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515aa86-e722-4aa1-a17f-f670de028b0d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:04.119485 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515aa86-e722-4aa1-a17f-f670de028b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:04.136346 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a515aa86-e722-4aa1-a17f-f670de028b0d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:03:04.137586 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a515aa86-e722-4aa1-a17f-f670de028b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:03:04.201596 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 634/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:03:04.224528 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c71b-2f07-4188-a0ad-4ff43c3392e8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:04.329109 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c71b-2f07-4188-a0ad-4ff43c3392e8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:04.361349 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d0518-195f-4e7f-8333-ae6adc748584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:04.362127 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0518-195f-4e7f-8333-ae6adc748584 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:04.362404 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0518-195f-4e7f-8333-ae6adc748584 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:04.362670 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0518-195f-4e7f-8333-ae6adc748584 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:04.372367 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d0518-195f-4e7f-8333-ae6adc748584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3e3d0518-195f-4e7f-8333-ae6adc748584 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:03:04.380665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:04.381785 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:04.382832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 629/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:04.388019 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515aa86-e722-4aa1-a17f-f670de028b0d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:04.483024 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515aa86-e722-4aa1-a17f-f670de028b0d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:04.515901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:04.516573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:04.516877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:04.517150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:04.517889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:04.518189 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:04.519558 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:04.528657 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 635/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:04.534605 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d0518-195f-4e7f-8333-ae6adc748584 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:04.633004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d0518-195f-4e7f-8333-ae6adc748584 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:04.664108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:04.664926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:04.665201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:04.665471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:04.675428 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:04.677399 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:03:04.694104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:04.695176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:04.696387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:03:04.696387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:03:04.696387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:04.696387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:04.696387 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 630/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:04.701179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:04.795474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31e05-f010-4f7b-bc3b-332682538f1c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:04.828184 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:04.828871 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:04.829155 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:04.829430 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:04.830148 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:04.830453 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:04.831811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:04.843191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 636/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:04.848957 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:04.945402 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d3a62-f5bd-4eda-a625-f2c291ce5766 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:04.977128 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:04.977918 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:04.978194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:04.978466 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:04.985846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:04.987299 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:03:05.001950 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:05.003090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:05.004846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 631/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:03:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:05.009545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:05.110230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8bac-0e7b-4952-b0f1-4afeb7dba2bc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:05.144242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:05.145011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:05.145889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:05.146241 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:05.147004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:05.147309 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:05.148754 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:05.165887 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 637/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 14:03:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:05.171569 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:05.267676 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc7055-5364-4955-8378-8610f2c9aa1b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:05.302849 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:05.303661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:05.303938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:05.304205 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:05.315862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:05.318675 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:03:05.337459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:05.338623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:05.339831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:03:05.339831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:03:05.339831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:05.339831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:05.339831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 632/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:05.344650 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:05.446897 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269d02a-d92f-44a0-866d-cf8dd2c93ee3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:05.485444 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:05.486133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:05.486416 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:05.486693 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:05.487428 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:05.487735 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:05.489251 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:05.501657 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 638/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:05.507440 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:05.622737 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f2078-5f44-4f9d-941a-77b176711caf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:05.655803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:05.656591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:05.656908 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:05.657187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:05.664578 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:05.666048 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:03:05.680497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:05.681552 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:05.682787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 633/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:03:05.687540 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:05.784029 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938433e4-65e0-40e4-a80d-6badff97af17 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:05.816272 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91217ac-6841-495c-a0ed-0faaa8d64792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:05.817721 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91217ac-6841-495c-a0ed-0faaa8d64792 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:05.818015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91217ac-6841-495c-a0ed-0faaa8d64792 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:05.818287 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91217ac-6841-495c-a0ed-0faaa8d64792 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:05.819065 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91217ac-6841-495c-a0ed-0faaa8d64792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:05.819365 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91217ac-6841-495c-a0ed-0faaa8d64792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:05.820815 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91217ac-6841-495c-a0ed-0faaa8d64792 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:05.832302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 639/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:05.838951 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:05.941826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209621-042c-4921-9600-d3dc9aa7dda2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:05.976169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9caf2b-2c73-4ced-b8cf-9e8be13909e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:05.977084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caf2b-2c73-4ced-b8cf-9e8be13909e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:05.977364 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caf2b-2c73-4ced-b8cf-9e8be13909e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:05.977636 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caf2b-2c73-4ced-b8cf-9e8be13909e9 None admin] PATH_INFO: `/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/a758fc0f31ca40db96d0625dbb5d4c0e/roles/52bf3a299728408b8384e30e08547fd8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:05.979557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9caf2b-2c73-4ced-b8cf-9e8be13909e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=234bca5b36fd483b9b37f1883b5028ce, user_id=a758fc0f31ca40db96d0625dbb5d4c0e, role_id=52bf3a299728408b8384e30e08547fd8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:05.980998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9caf2b-2c73-4ced-b8cf-9e8be13909e9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:05.993546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 634/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 14:03:05 2022] PUT /identity/v3/projects/234bca5b36fd483b9b37f1883b5028ce/users/a758fc0f31ca40db96d0625dbb5d4c0e/roles/52bf3a299728408b8384e30e08547fd8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:03:08.214279 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344a119-28d2-4b3e-8882-d955d9951ab0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:08.214786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344a119-28d2-4b3e-8882-d955d9951ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:08.214786 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344a119-28d2-4b3e-8882-d955d9951ab0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:08.216076 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 640/1274] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:03:08.221393 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5801c-9a76-4b95-8221-e26dbf3fb27c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:08.221789 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5801c-9a76-4b95-8221-e26dbf3fb27c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:08.221949 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5801c-9a76-4b95-8221-e26dbf3fb27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:08.238451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dec5801c-9a76-4b95-8221-e26dbf3fb27c None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:03:08.240224 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dec5801c-9a76-4b95-8221-e26dbf3fb27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:03:08.303884 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 635/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:03:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:03:08.327027 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344a119-28d2-4b3e-8882-d955d9951ab0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:08.427589 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344a119-28d2-4b3e-8882-d955d9951ab0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:08.459714 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180915a7-baff-4eb1-971c-3481237d42d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:08.460502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180915a7-baff-4eb1-971c-3481237d42d5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:08.460814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180915a7-baff-4eb1-971c-3481237d42d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:08.461094 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180915a7-baff-4eb1-971c-3481237d42d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:08.470982 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180915a7-baff-4eb1-971c-3481237d42d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-180915a7-baff-4eb1-971c-3481237d42d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:03:08.479408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:08.480512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:08.481556 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 641/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 14:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:08.486625 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5801c-9a76-4b95-8221-e26dbf3fb27c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:08.590245 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5801c-9a76-4b95-8221-e26dbf3fb27c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:08.624401 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:08.625097 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:08.625380 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:08.625654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:08.626394 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:08.626697 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:08.628042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:08.635788 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 636/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 14:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:08.641523 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180915a7-baff-4eb1-971c-3481237d42d5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:08.738136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180915a7-baff-4eb1-971c-3481237d42d5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:08.769808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:08.770683 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:08.771001 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:08.771325 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:08.781329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:08.782756 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:03:08.799402 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:08.800499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:08.802448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:03:08.802448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:03:08.802448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:08.802448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:08.802448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 642/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:08.807233 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:08.901434 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e26690-29c5-4512-a82d-30932bdb0a66 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:08.934980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:08.935637 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:08.935913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:08.936183 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:08.936926 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:08.937224 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:08.938628 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:08.951070 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 637/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:08.956693 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:09.051344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6c28-505f-44ee-9793-ce833c9192a8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:09.083641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:09.084434 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:09.084737 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:09.085010 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:09.092271 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:09.093720 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:03:09.107965 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:09.109127 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:09.110166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 643/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:03:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:09.114924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:09.206415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3074b-6564-4cdb-9817-4c1cac214d2a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:09.240234 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:09.240967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:09.241197 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:09.241462 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:09.242304 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:09.242792 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:09.244216 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:09.261857 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 638/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 14:03:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:09.267713 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:09.363153 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429626e-c0bc-44ab-8513-d9fdfbe3e8db None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:09.394278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb7ac1-ee57-4f85-a38b-50db54527531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:09.394910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb7ac1-ee57-4f85-a38b-50db54527531 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:09.395185 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb7ac1-ee57-4f85-a38b-50db54527531 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:09.395993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb7ac1-ee57-4f85-a38b-50db54527531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:09.459642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb7ac1-ee57-4f85-a38b-50db54527531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:09.461115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb7ac1-ee57-4f85-a38b-50db54527531 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:09.555522 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 644/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 14:03:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:03:09.561416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:09.658391 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee904b0-64c8-4588-96ad-9e5dfe7b6ebc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:09.689940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:09.690725 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:09.691001 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:09.691270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:09.701532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:09.702946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:03:09.720317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:09.721460 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:09.722392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:03:09.722392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:03:09.722392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:03:09.722392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:09.722392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 639/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:09.727657 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb7ac1-ee57-4f85-a38b-50db54527531 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:09.820908 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb7ac1-ee57-4f85-a38b-50db54527531 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:09.852344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:09.853023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:09.853301 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:09.853571 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:09.854276 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:09.854572 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:09.855975 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:09.867464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 645/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 14:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:09.873395 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:09.968570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9492a-bf5c-4c0d-b33c-a26b60479518 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:10.001072 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:10.001859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:10.002134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:10.002398 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:10.009514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:10.010934 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:03:10.024202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:10.025310 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: ERROR keystone.server.flask.application May 16 14:03:10.026416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 640/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 14:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:10.031364 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:10.126274 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0b802-67bb-46b7-a015-b16bfa7aa99d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:10.162600 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80783742-e323-405a-a2a8-b2bf292dec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:10.163269 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80783742-e323-405a-a2a8-b2bf292dec7a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:10.163547 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80783742-e323-405a-a2a8-b2bf292dec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:10.163818 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80783742-e323-405a-a2a8-b2bf292dec7a None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:10.164612 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80783742-e323-405a-a2a8-b2bf292dec7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:10.164947 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80783742-e323-405a-a2a8-b2bf292dec7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:10.166394 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80783742-e323-405a-a2a8-b2bf292dec7a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:10.179073 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 646/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 14:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:10.185316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:10.281330 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c6968-3115-4bd7-afdc-3a82da71c6d7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:10.313237 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890831c2-ac6f-469e-b193-8e3de754edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:10.313886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890831c2-ac6f-469e-b193-8e3de754edd6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:10.314166 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890831c2-ac6f-469e-b193-8e3de754edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:10.314439 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890831c2-ac6f-469e-b193-8e3de754edd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:10.315261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890831c2-ac6f-469e-b193-8e3de754edd6 None admin] RBAC: Adding query filter params (role.id=52bf3a299728408b8384e30e08547fd8, scope.project.id=234bca5b36fd483b9b37f1883b5028ce, user.id=a758fc0f31ca40db96d0625dbb5d4c0e) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:10.315567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890831c2-ac6f-469e-b193-8e3de754edd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:10.317000 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890831c2-ac6f-469e-b193-8e3de754edd6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:10.323288 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 641/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 14:03:10 2022] GET /identity/v3/role_assignments?user.id=a758fc0f31ca40db96d0625dbb5d4c0e&scope.project.id=234bca5b36fd483b9b37f1883b5028ce&role.id=52bf3a299728408b8384e30e08547fd8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:12.607967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56b6a-24c8-4ea0-b400-37acc3c45a67 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:12.608506 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56b6a-24c8-4ea0-b400-37acc3c45a67 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:12.608506 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56b6a-24c8-4ea0-b400-37acc3c45a67 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:12.609889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 647/1288] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:03:12.617414 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1cf9c-6288-4d23-8f5a-080efc8b51d2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:12.617877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1cf9c-6288-4d23-8f5a-080efc8b51d2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:12.617965 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1cf9c-6288-4d23-8f5a-080efc8b51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:12.635066 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-40e1cf9c-6288-4d23-8f5a-080efc8b51d2 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:03:12.636250 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-40e1cf9c-6288-4d23-8f5a-080efc8b51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:03:12.707674 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 642/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:03:12.730259 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56b6a-24c8-4ea0-b400-37acc3c45a67 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:12.837566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56b6a-24c8-4ea0-b400-37acc3c45a67 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:12.871329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:12.872294 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:12.872573 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:12.872878 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:12.873526 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:12.874883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:12.886747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:12.887994 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:12.889063 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 648/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:03:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:12.894471 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1cf9c-6288-4d23-8f5a-080efc8b51d2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:12.999436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1cf9c-6288-4d23-8f5a-080efc8b51d2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:13.034169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b694d-0723-4933-a8de-f4322f59b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:13.034826 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b694d-0723-4933-a8de-f4322f59b866 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:13.035106 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b694d-0723-4933-a8de-f4322f59b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:13.035378 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b694d-0723-4933-a8de-f4322f59b866 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:13.036078 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b694d-0723-4933-a8de-f4322f59b866 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:13.036415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b694d-0723-4933-a8de-f4322f59b866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:13.038337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b694d-0723-4933-a8de-f4322f59b866 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:13.043213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 643/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Mon May 16 14:03:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:13.049154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:13.144904 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c79698-f410-4355-b436-06075c8935e7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:13.178111 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce0ee0-30a6-48cc-b33e-e288a2cbc331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:13.178763 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce0ee0-30a6-48cc-b33e-e288a2cbc331 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:13.179042 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce0ee0-30a6-48cc-b33e-e288a2cbc331 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:13.179314 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce0ee0-30a6-48cc-b33e-e288a2cbc331 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:13.180014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce0ee0-30a6-48cc-b33e-e288a2cbc331 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:13.180317 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce0ee0-30a6-48cc-b33e-e288a2cbc331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:13.181716 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce0ee0-30a6-48cc-b33e-e288a2cbc331 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:13.186154 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 649/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Mon May 16 14:03:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:15.442591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e85d2-5ee9-42bc-b2c0-ea4a7088ae87 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:15.443621 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e85d2-5ee9-42bc-b2c0-ea4a7088ae87 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:15.443803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e85d2-5ee9-42bc-b2c0-ea4a7088ae87 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:15.445362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 644/1293] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:03:15.450585 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65507ac-8b06-4721-9d9c-3b9397c56872 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:15.450989 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65507ac-8b06-4721-9d9c-3b9397c56872 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:15.451133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65507ac-8b06-4721-9d9c-3b9397c56872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:15.469685 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f65507ac-8b06-4721-9d9c-3b9397c56872 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:03:15.470808 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f65507ac-8b06-4721-9d9c-3b9397c56872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:03:15.539090 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 650/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:03:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:03:15.562607 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e85d2-5ee9-42bc-b2c0-ea4a7088ae87 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:15.674356 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e85d2-5ee9-42bc-b2c0-ea4a7088ae87 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:15.706426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231f498-2587-4cf4-95e3-26f1f380e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:15.706998 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231f498-2587-4cf4-95e3-26f1f380e32b None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:15.707270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231f498-2587-4cf4-95e3-26f1f380e32b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:15.707541 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231f498-2587-4cf4-95e3-26f1f380e32b None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:15.708242 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231f498-2587-4cf4-95e3-26f1f380e32b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:15.710182 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231f498-2587-4cf4-95e3-26f1f380e32b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:15.723014 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 645/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 14:03:15 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:03:17.984535 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e666bc-989d-4377-ba1b-5b489463fbc9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:17.985080 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e666bc-989d-4377-ba1b-5b489463fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:17.985080 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e666bc-989d-4377-ba1b-5b489463fbc9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:17.986455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 651/1296] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:03:17.992129 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f3572-74ed-4077-99cd-a210d8e0ed72 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:17.992537 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f3572-74ed-4077-99cd-a210d8e0ed72 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:17.992695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f3572-74ed-4077-99cd-a210d8e0ed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:18.009118 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-859f3572-74ed-4077-99cd-a210d8e0ed72 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:03:18.010300 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-859f3572-74ed-4077-99cd-a210d8e0ed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:03:18.078336 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 646/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:03:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:03:18.101610 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e666bc-989d-4377-ba1b-5b489463fbc9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:18.197903 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e666bc-989d-4377-ba1b-5b489463fbc9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:18.231618 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:18.232410 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:18.232712 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:18.232992 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:18.233641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:18.235053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:18.247902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:18.249191 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:18.250069 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 652/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:03:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:18.255707 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f3572-74ed-4077-99cd-a210d8e0ed72 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:18.348888 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f3572-74ed-4077-99cd-a210d8e0ed72 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:18.381980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:18.382644 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:18.382930 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:18.383206 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:18.383910 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:18.384216 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:18.385598 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:18.390628 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 647/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Mon May 16 14:03:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:18.397082 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:18.494634 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef666686-2bb7-42b9-85e6-b6ee4772bf30 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:18.527488 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3259eae-e552-4bc6-a001-71a5d508380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:18.528222 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259eae-e552-4bc6-a001-71a5d508380e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:18.528550 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259eae-e552-4bc6-a001-71a5d508380e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:18.528931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259eae-e552-4bc6-a001-71a5d508380e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:18.529953 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3259eae-e552-4bc6-a001-71a5d508380e None admin] RBAC: Adding query filter params (interface=public, service_id=eff151ac5081489aa50de7fb5c607dbe, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:18.530521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3259eae-e552-4bc6-a001-71a5d508380e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:18.532495 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3259eae-e552-4bc6-a001-71a5d508380e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:18.537942 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 653/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 14:03:18 2022] GET /identity/v3/endpoints?service_id=eff151ac5081489aa50de7fb5c607dbe&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:18.543532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:18.636386 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc7571-c297-4c18-a9d0-8ca219b0a544 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:18.667716 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1865e-8ddd-4687-82e2-864dc154ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:18.668373 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1865e-8ddd-4687-82e2-864dc154ded9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:18.668649 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1865e-8ddd-4687-82e2-864dc154ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:18.668955 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1865e-8ddd-4687-82e2-864dc154ded9 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:18.669624 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1865e-8ddd-4687-82e2-864dc154ded9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:18.670971 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1865e-8ddd-4687-82e2-864dc154ded9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:18.677532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 648/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 14:03:18 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:03:21.020534 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c29c-40f5-4bd0-a579-990456badfe6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:21.021092 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c29c-40f5-4bd0-a579-990456badfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:21.021092 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c29c-40f5-4bd0-a579-990456badfe6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:21.022602 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 654/1302] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:03:21.028073 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c7b1-fc4d-45af-8fba-0693af2911e3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:21.028483 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c7b1-fc4d-45af-8fba-0693af2911e3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:21.028623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c7b1-fc4d-45af-8fba-0693af2911e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:21.045509 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b301c7b1-fc4d-45af-8fba-0693af2911e3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:03:21.046680 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b301c7b1-fc4d-45af-8fba-0693af2911e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:03:21.111366 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 649/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:03:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:03:21.133997 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7c29c-40f5-4bd0-a579-990456badfe6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:21.233931 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7c29c-40f5-4bd0-a579-990456badfe6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:21.265968 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:21.266759 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:21.267041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:21.267313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:21.267957 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:21.269346 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:03:21.281566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:03:21.282798 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: ERROR keystone.server.flask.application May 16 14:03:21.283663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 655/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 14:03:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:03:21.289661 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301c7b1-fc4d-45af-8fba-0693af2911e3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:21.381123 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301c7b1-fc4d-45af-8fba-0693af2911e3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:21.413326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2011b45-54a5-4227-b0df-e0cdd3d27c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:21.413980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2011b45-54a5-4227-b0df-e0cdd3d27c36 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:21.414257 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2011b45-54a5-4227-b0df-e0cdd3d27c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:21.414527 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2011b45-54a5-4227-b0df-e0cdd3d27c36 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:21.415225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2011b45-54a5-4227-b0df-e0cdd3d27c36 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:03:21.415522 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2011b45-54a5-4227-b0df-e0cdd3d27c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:21.416889 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2011b45-54a5-4227-b0df-e0cdd3d27c36 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:21.421938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 650/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Mon May 16 14:03:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:03:21.427796 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:03:21.523462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e011cc6-a91d-43f3-b60b-10341927aabf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:03:21.554879 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990925d9-9da5-4c64-b87c-37f50c56bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:03:21.555524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990925d9-9da5-4c64-b87c-37f50c56bd05 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:03:21.555800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990925d9-9da5-4c64-b87c-37f50c56bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:03:21.556067 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990925d9-9da5-4c64-b87c-37f50c56bd05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:03:21.556818 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990925d9-9da5-4c64-b87c-37f50c56bd05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:03:21.558169 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990925d9-9da5-4c64-b87c-37f50c56bd05 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:03:21.577707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 656/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 14:03:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:04:32.190136 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61377-d284-4054-9708-7be9a9389b0f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:32.191029 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61377-d284-4054-9708-7be9a9389b0f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:32.191311 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61377-d284-4054-9708-7be9a9389b0f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:32.192699 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 651/1307] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:32.198072 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36d85-23c1-4d6b-b22f-1b68e0574d8a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:32.198524 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36d85-23c1-4d6b-b22f-1b68e0574d8a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:32.198635 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36d85-23c1-4d6b-b22f-1b68e0574d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:32.272841 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2ca36d85-23c1-4d6b-b22f-1b68e0574d8a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:32.274075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2ca36d85-23c1-4d6b-b22f-1b68e0574d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:32.374583 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 657/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:32.458370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1591-6c1f-49d1-9e77-19784c8b0200 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:32.458370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1591-6c1f-49d1-9e77-19784c8b0200 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:32.458370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1591-6c1f-49d1-9e77-19784c8b0200 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:32.458370 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 652/1309] 10.222.0.13 () {54 vars in 964 bytes} [Mon May 16 14:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:32.469839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6cab-bc9d-4686-b215-573e6d64de41 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:32.469839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6cab-bc9d-4686-b215-573e6d64de41 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:32.469839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6cab-bc9d-4686-b215-573e6d64de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:32.601421 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8b8a6cab-bc9d-4686-b215-573e6d64de41 None None] MFA Rules not processed for user `4c352582d4014e008ff92350808c84f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:32.602960 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8b8a6cab-bc9d-4686-b215-573e6d64de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:32.735173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 658/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Mon May 16 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:32.745568 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1591-6c1f-49d1-9e77-19784c8b0200 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:32.748503 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-42de1591-6c1f-49d1-9e77-19784c8b0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:32.869759 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1591-6c1f-49d1-9e77-19784c8b0200 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:32.945868 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113c0a8-65ca-4a35-befb-62240c3933a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:32.946527 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113c0a8-65ca-4a35-befb-62240c3933a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:32.946811 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113c0a8-65ca-4a35-befb-62240c3933a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:32.947100 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113c0a8-65ca-4a35-befb-62240c3933a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:32.948768 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2113c0a8-65ca-4a35-befb-62240c3933a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:33.060589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113c0a8-65ca-4a35-befb-62240c3933a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:33.062090 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113c0a8-65ca-4a35-befb-62240c3933a6 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:33.084929 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 653/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 14:04:36.108466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252477-69e1-480d-b604-e72ff5613360 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:36.109397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252477-69e1-480d-b604-e72ff5613360 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:36.109675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252477-69e1-480d-b604-e72ff5613360 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:36.111268 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 659/1312] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:36.117198 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193464a-2856-4166-90bb-020ea24566a5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:36.117683 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193464a-2856-4166-90bb-020ea24566a5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:36.117782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193464a-2856-4166-90bb-020ea24566a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:36.203171 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e193464a-2856-4166-90bb-020ea24566a5 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:36.204391 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e193464a-2856-4166-90bb-020ea24566a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:36.308708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 654/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:36.343574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252477-69e1-480d-b604-e72ff5613360 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:36.345282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d252477-69e1-480d-b604-e72ff5613360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:36.455025 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252477-69e1-480d-b604-e72ff5613360 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:36.532241 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091203e5-dbd6-4602-9f8f-aded4e0dca7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:36.533015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091203e5-dbd6-4602-9f8f-aded4e0dca7f service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:36.533470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091203e5-dbd6-4602-9f8f-aded4e0dca7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:36.533761 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091203e5-dbd6-4602-9f8f-aded4e0dca7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:36.536020 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-091203e5-dbd6-4602-9f8f-aded4e0dca7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:36.670823 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091203e5-dbd6-4602-9f8f-aded4e0dca7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:36.672632 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091203e5-dbd6-4602-9f8f-aded4e0dca7f service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:36.692413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 660/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:04:39.305970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ff5e-d259-4377-aa63-71e596ed7daa None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:39.306533 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ff5e-d259-4377-aa63-71e596ed7daa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:39.306634 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ff5e-d259-4377-aa63-71e596ed7daa None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:39.307941 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 655/1315] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:39.313799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa01d0-f650-470d-8b62-c7838d46d13e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:39.314216 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa01d0-f650-470d-8b62-c7838d46d13e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:39.314351 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa01d0-f650-470d-8b62-c7838d46d13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:39.377346 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4afa01d0-f650-470d-8b62-c7838d46d13e None None] MFA Rules not processed for user `d312d466cfd04c698b6812ee7c7c1fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:39.378571 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4afa01d0-f650-470d-8b62-c7838d46d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:39.476752 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 661/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:39.519346 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3ff5e-d259-4377-aa63-71e596ed7daa None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:39.520924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-33e3ff5e-d259-4377-aa63-71e596ed7daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:39.648301 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3ff5e-d259-4377-aa63-71e596ed7daa None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:39.724241 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983990e-d5c9-49bf-8076-4d3d69b53639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:39.724933 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983990e-d5c9-49bf-8076-4d3d69b53639 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:39.725221 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983990e-d5c9-49bf-8076-4d3d69b53639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:39.725499 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983990e-d5c9-49bf-8076-4d3d69b53639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:39.727219 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f983990e-d5c9-49bf-8076-4d3d69b53639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:39.843589 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983990e-d5c9-49bf-8076-4d3d69b53639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:39.845072 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983990e-d5c9-49bf-8076-4d3d69b53639 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:39.864252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 656/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:04:42.766939 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2017-6e7e-468b-9692-6abbbe27eb7c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:42.767487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2017-6e7e-468b-9692-6abbbe27eb7c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:42.767487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2017-6e7e-468b-9692-6abbbe27eb7c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:42.768868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 662/1318] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:42.774316 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2932-b410-4a60-85e1-18f22a89c2e6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:42.774749 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2932-b410-4a60-85e1-18f22a89c2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:42.774856 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2932-b410-4a60-85e1-18f22a89c2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:42.837729 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-fe2e2932-b410-4a60-85e1-18f22a89c2e6 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:42.838993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fe2e2932-b410-4a60-85e1-18f22a89c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:42.933120 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 657/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:42.972388 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2017-6e7e-468b-9692-6abbbe27eb7c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:42.973907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9b3f2017-6e7e-468b-9692-6abbbe27eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:43.074192 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2017-6e7e-468b-9692-6abbbe27eb7c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:43.147504 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5d9fa-978d-47bd-a52d-ec78d49457e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:43.148145 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d9fa-978d-47bd-a52d-ec78d49457e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:43.148421 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d9fa-978d-47bd-a52d-ec78d49457e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:43.148709 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d9fa-978d-47bd-a52d-ec78d49457e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:43.150341 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-08f5d9fa-978d-47bd-a52d-ec78d49457e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:43.255300 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5d9fa-978d-47bd-a52d-ec78d49457e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:43.256766 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5d9fa-978d-47bd-a52d-ec78d49457e4 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:43.276521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 663/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:04:46.239493 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc783efd-11dc-4d1e-ac8c-b4ad6cded0d4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:46.240209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc783efd-11dc-4d1e-ac8c-b4ad6cded0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:46.240209 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc783efd-11dc-4d1e-ac8c-b4ad6cded0d4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:46.241346 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 658/1321] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:46.247225 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea0a5-54bc-405e-8256-d1b209c48b57 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:46.248131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea0a5-54bc-405e-8256-d1b209c48b57 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:46.248131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea0a5-54bc-405e-8256-d1b209c48b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:46.328794 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a32ea0a5-54bc-405e-8256-d1b209c48b57 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:46.330105 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a32ea0a5-54bc-405e-8256-d1b209c48b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:46.433370 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 664/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:04:46.471419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc783efd-11dc-4d1e-ac8c-b4ad6cded0d4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:46.473031 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fc783efd-11dc-4d1e-ac8c-b4ad6cded0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:46.584539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc783efd-11dc-4d1e-ac8c-b4ad6cded0d4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:46.672766 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87029a-9895-4e55-bee5-ad5e119350d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:46.673482 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87029a-9895-4e55-bee5-ad5e119350d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:46.673832 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87029a-9895-4e55-bee5-ad5e119350d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:46.674283 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87029a-9895-4e55-bee5-ad5e119350d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:46.676185 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1b87029a-9895-4e55-bee5-ad5e119350d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:46.802728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87029a-9895-4e55-bee5-ad5e119350d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:46.804178 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87029a-9895-4e55-bee5-ad5e119350d0 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:46.829436 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 659/1323] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 14:04:49.243427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab89d-5e1a-46ee-892a-c63570473f9f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:49.243993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab89d-5e1a-46ee-892a-c63570473f9f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:49.243993 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab89d-5e1a-46ee-892a-c63570473f9f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:49.245526 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 665/1324] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:49.251539 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c40f2-9191-4fd4-a3aa-3fb7a308ee80 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:49.252018 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c40f2-9191-4fd4-a3aa-3fb7a308ee80 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:49.252213 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c40f2-9191-4fd4-a3aa-3fb7a308ee80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:49.320457 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1d5c40f2-9191-4fd4-a3aa-3fb7a308ee80 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:49.321695 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1d5c40f2-9191-4fd4-a3aa-3fb7a308ee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:49.430360 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 660/1325] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:49.483499 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6a63-4a28-483e-912d-65e189b3d3c1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:49.483780 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6a63-4a28-483e-912d-65e189b3d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:49.484074 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6a63-4a28-483e-912d-65e189b3d3c1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:49.485470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 666/1326] 10.222.0.13 () {54 vars in 964 bytes} [Mon May 16 14:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:04:49.491618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425642-8e85-498b-816e-dcb9d68a7b8d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:49.491983 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425642-8e85-498b-816e-dcb9d68a7b8d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:49.492323 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425642-8e85-498b-816e-dcb9d68a7b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:49.568108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ab425642-8e85-498b-816e-dcb9d68a7b8d None None] MFA Rules not processed for user `4c352582d4014e008ff92350808c84f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:49.569348 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ab425642-8e85-498b-816e-dcb9d68a7b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:49.642448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 661/1327] 10.222.0.13 () {58 vars in 1061 bytes} [Mon May 16 14:04:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:49.651316 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6a63-4a28-483e-912d-65e189b3d3c1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:49.653704 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-47bd6a63-4a28-483e-912d-65e189b3d3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:49.763343 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6a63-4a28-483e-912d-65e189b3d3c1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:49.836713 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebc26b-2914-40e6-9780-71f67292d830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:49.837278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebc26b-2914-40e6-9780-71f67292d830 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:49.837560 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebc26b-2914-40e6-9780-71f67292d830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:49.837836 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebc26b-2914-40e6-9780-71f67292d830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:49.840004 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-76ebc26b-2914-40e6-9780-71f67292d830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:49.951321 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebc26b-2914-40e6-9780-71f67292d830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:49.952792 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebc26b-2914-40e6-9780-71f67292d830 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:49.971172 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 667/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:04:52.578121 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269a94-82ce-40ae-bebd-66326d3e4cbf None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:52.578650 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269a94-82ce-40ae-bebd-66326d3e4cbf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:52.578773 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269a94-82ce-40ae-bebd-66326d3e4cbf None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:52.580074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 662/1329] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:52.585566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3672-d80b-4543-ac83-3e79a0fa171e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:52.586011 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3672-d80b-4543-ac83-3e79a0fa171e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:52.586153 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3672-d80b-4543-ac83-3e79a0fa171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:52.656621 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-64ea3672-d80b-4543-ac83-3e79a0fa171e None None] MFA Rules not processed for user `d312d466cfd04c698b6812ee7c7c1fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:52.657910 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-64ea3672-d80b-4543-ac83-3e79a0fa171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:52.767923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 668/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:52.807279 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf269a94-82ce-40ae-bebd-66326d3e4cbf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:52.808806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cf269a94-82ce-40ae-bebd-66326d3e4cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:52.919759 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf269a94-82ce-40ae-bebd-66326d3e4cbf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:52.995221 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c91515-9035-43ef-84fe-bdb9c7951d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:52.995859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91515-9035-43ef-84fe-bdb9c7951d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:52.996139 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91515-9035-43ef-84fe-bdb9c7951d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:52.996415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91515-9035-43ef-84fe-bdb9c7951d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:52.998113 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-23c91515-9035-43ef-84fe-bdb9c7951d7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:53.120831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c91515-9035-43ef-84fe-bdb9c7951d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:53.122279 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c91515-9035-43ef-84fe-bdb9c7951d7d service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:53.146317 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 663/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 14:04:55.903986 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383e6d4-1cfd-4b0c-b862-ce8f3a9abf8a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:55.904464 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383e6d4-1cfd-4b0c-b862-ce8f3a9abf8a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:55.905167 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383e6d4-1cfd-4b0c-b862-ce8f3a9abf8a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:55.906102 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 669/1332] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:55.911935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a79f5-18e8-4d24-9868-6b09f077dc10 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:55.912469 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a79f5-18e8-4d24-9868-6b09f077dc10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:55.912563 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a79f5-18e8-4d24-9868-6b09f077dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:55.994654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-906a79f5-18e8-4d24-9868-6b09f077dc10 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:55.995920 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-906a79f5-18e8-4d24-9868-6b09f077dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:56.095255 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 664/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:56.131640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383e6d4-1cfd-4b0c-b862-ce8f3a9abf8a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:56.133260 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9383e6d4-1cfd-4b0c-b862-ce8f3a9abf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:56.236197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383e6d4-1cfd-4b0c-b862-ce8f3a9abf8a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:56.318281 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf0d7f-d119-4fe0-96ab-3afcb2109213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:56.319131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf0d7f-d119-4fe0-96ab-3afcb2109213 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:56.319531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf0d7f-d119-4fe0-96ab-3afcb2109213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:56.319921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf0d7f-d119-4fe0-96ab-3afcb2109213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:56.322391 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54bf0d7f-d119-4fe0-96ab-3afcb2109213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:56.440093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf0d7f-d119-4fe0-96ab-3afcb2109213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:56.441572 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf0d7f-d119-4fe0-96ab-3afcb2109213 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:56.459840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 670/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:04:58.774886 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dea5e-3708-4ffa-886c-604c96ac70f8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:58.775456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dea5e-3708-4ffa-886c-604c96ac70f8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:58.775456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dea5e-3708-4ffa-886c-604c96ac70f8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:58.776816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 665/1335] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:04:58.782150 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251819f-c8b2-4ff6-9f7b-824cfae621eb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:58.782574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251819f-c8b2-4ff6-9f7b-824cfae621eb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:58.782682 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251819f-c8b2-4ff6-9f7b-824cfae621eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:58.849680 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c251819f-c8b2-4ff6-9f7b-824cfae621eb None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:04:58.851411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c251819f-c8b2-4ff6-9f7b-824cfae621eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:58.958938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 671/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:04:58.999021 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dea5e-3708-4ffa-886c-604c96ac70f8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:04:59.000566 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-234dea5e-3708-4ffa-886c-604c96ac70f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:59.106547 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dea5e-3708-4ffa-886c-604c96ac70f8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:04:59.180816 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b77c-48da-4755-8d3b-9baefd98e12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:04:59.181475 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b77c-48da-4755-8d3b-9baefd98e12b service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:04:59.181751 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b77c-48da-4755-8d3b-9baefd98e12b service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:04:59.182017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b77c-48da-4755-8d3b-9baefd98e12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:04:59.183658 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2d99b77c-48da-4755-8d3b-9baefd98e12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:04:59.308740 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b77c-48da-4755-8d3b-9baefd98e12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:04:59.310197 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b77c-48da-4755-8d3b-9baefd98e12b service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:04:59.330461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 666/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 14:05:02.033243 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c666-3586-4558-9a51-8be4ccd3780e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:02.033818 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c666-3586-4558-9a51-8be4ccd3780e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:02.033818 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c666-3586-4558-9a51-8be4ccd3780e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:02.035126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 672/1338] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:05:02.040488 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff106e3-4eb1-444a-a8c7-d7d414339e27 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:02.041013 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff106e3-4eb1-444a-a8c7-d7d414339e27 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:02.041109 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff106e3-4eb1-444a-a8c7-d7d414339e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:02.105887 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6ff106e3-4eb1-444a-a8c7-d7d414339e27 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:02.107104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6ff106e3-4eb1-444a-a8c7-d7d414339e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:02.202361 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 667/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:02.237667 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8c666-3586-4558-9a51-8be4ccd3780e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:02.241315 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-50a8c666-3586-4558-9a51-8be4ccd3780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:02.347390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8c666-3586-4558-9a51-8be4ccd3780e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:02.360071 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f1fcc-13d0-4a56-800b-b3dc34b0ecf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:02.360772 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f1fcc-13d0-4a56-800b-b3dc34b0ecf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:02.361052 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f1fcc-13d0-4a56-800b-b3dc34b0ecf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:02.361323 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f1fcc-13d0-4a56-800b-b3dc34b0ecf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:02.363330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-264f1fcc-13d0-4a56-800b-b3dc34b0ecf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:02.465031 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f1fcc-13d0-4a56-800b-b3dc34b0ecf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:02.466391 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f1fcc-13d0-4a56-800b-b3dc34b0ecf1 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:02.489234 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 673/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:06.830781 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5bfba-b315-407e-badf-8e07d5cfd904 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:06.831337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5bfba-b315-407e-badf-8e07d5cfd904 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:06.831337 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5bfba-b315-407e-badf-8e07d5cfd904 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:06.832812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 668/1341] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:06.838313 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00f2b-e0b4-44fc-a80e-89324edb2262 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:06.838738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00f2b-e0b4-44fc-a80e-89324edb2262 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:06.838867 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00f2b-e0b4-44fc-a80e-89324edb2262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:06.886807 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d4d00f2b-e0b4-44fc-a80e-89324edb2262 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:06.887927 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d4d00f2b-e0b4-44fc-a80e-89324edb2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:06.966312 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 674/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:07.004854 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5bfba-b315-407e-badf-8e07d5cfd904 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:07.007406 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-70e5bfba-b315-407e-badf-8e07d5cfd904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:07.030109 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5bfba-b315-407e-badf-8e07d5cfd904 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:07.033581 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c596dc1-f54b-4a92-9714-c782430bd229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:07.034214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c596dc1-f54b-4a92-9714-c782430bd229 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:07.034489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c596dc1-f54b-4a92-9714-c782430bd229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:07.035364 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c596dc1-f54b-4a92-9714-c782430bd229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:07.044259 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c596dc1-f54b-4a92-9714-c782430bd229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:07.045716 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c596dc1-f54b-4a92-9714-c782430bd229 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:07.055034 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 669/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 14:05:09.978458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1313169-1107-48e1-acea-fcdafd05970e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:09.978987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1313169-1107-48e1-acea-fcdafd05970e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:09.979081 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1313169-1107-48e1-acea-fcdafd05970e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:09.980417 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 675/1344] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:09.985841 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb377a2-1e6b-4591-a899-c2192359a077 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:09.986254 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb377a2-1e6b-4591-a899-c2192359a077 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:09.986560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb377a2-1e6b-4591-a899-c2192359a077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:10.016102 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1bb377a2-1e6b-4591-a899-c2192359a077 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:10.018609 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1bb377a2-1e6b-4591-a899-c2192359a077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:10.032229 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 670/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:05:10.070925 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1313169-1107-48e1-acea-fcdafd05970e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:10.071820 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1313169-1107-48e1-acea-fcdafd05970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:10.086647 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1313169-1107-48e1-acea-fcdafd05970e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:10.090667 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15da480-305b-4012-beb3-7ebae5e37ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:10.091330 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da480-305b-4012-beb3-7ebae5e37ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:10.091606 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da480-305b-4012-beb3-7ebae5e37ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:10.091878 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da480-305b-4012-beb3-7ebae5e37ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:10.103693 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15da480-305b-4012-beb3-7ebae5e37ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:10.105183 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15da480-305b-4012-beb3-7ebae5e37ab6 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:10.115675 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 676/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:14.700899 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180b22b-3e97-47d9-97c6-1bb025b7c547 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:14.701474 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180b22b-3e97-47d9-97c6-1bb025b7c547 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:14.701474 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180b22b-3e97-47d9-97c6-1bb025b7c547 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:14.702932 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 671/1347] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:14.708565 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46839d6-3adc-4b17-9164-2538418be3dd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:14.709254 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46839d6-3adc-4b17-9164-2538418be3dd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:14.709254 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46839d6-3adc-4b17-9164-2538418be3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:14.730513 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a46839d6-3adc-4b17-9164-2538418be3dd None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:14.731718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a46839d6-3adc-4b17-9164-2538418be3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:14.744718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 677/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:05:14.781032 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180b22b-3e97-47d9-97c6-1bb025b7c547 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:14.803285 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180b22b-3e97-47d9-97c6-1bb025b7c547 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:14.807214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d3ee0-a4e1-47a8-a165-5537f3fc00d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:14.807877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3ee0-a4e1-47a8-a165-5537f3fc00d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:14.808159 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3ee0-a4e1-47a8-a165-5537f3fc00d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:14.808433 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3ee0-a4e1-47a8-a165-5537f3fc00d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:14.819088 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d3ee0-a4e1-47a8-a165-5537f3fc00d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:14.820555 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d3ee0-a4e1-47a8-a165-5537f3fc00d6 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:14.832303 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 672/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:21.061984 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760e4f0-03b8-4137-9dfa-7b1cc62a90df None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:21.062946 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760e4f0-03b8-4137-9dfa-7b1cc62a90df None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:21.063370 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760e4f0-03b8-4137-9dfa-7b1cc62a90df None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:21.065437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 678/1350] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 14:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:21.079806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2961-e3f7-4426-9ee3-835d4241bdb0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:21.080837 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2961-e3f7-4426-9ee3-835d4241bdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:21.081296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2961-e3f7-4426-9ee3-835d4241bdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:21.212652 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1b8b2961-e3f7-4426-9ee3-835d4241bdb0 None None] MFA Rules not processed for user `a758fc0f31ca40db96d0625dbb5d4c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:21.214296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1b8b2961-e3f7-4426-9ee3-835d4241bdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:21.364909 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 673/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 14:05:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:27.570017 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16035-4012-4046-b070-291d16845e7d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:27.571387 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16035-4012-4046-b070-291d16845e7d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:27.572041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16035-4012-4046-b070-291d16845e7d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:27.575463 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 679/1352] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 14:05:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:27.581815 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e10ec2-b34c-454b-98ba-01a0e897b59e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:27.582623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e10ec2-b34c-454b-98ba-01a0e897b59e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:27.582623 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e10ec2-b34c-454b-98ba-01a0e897b59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:27.612786 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-03e10ec2-b34c-454b-98ba-01a0e897b59e None None] MFA Rules not processed for user `a758fc0f31ca40db96d0625dbb5d4c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:27.615031 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-03e10ec2-b34c-454b-98ba-01a0e897b59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:27.631104 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 674/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 14:05:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:05:28.965087 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272df01a-4766-480c-83d4-9090ccdc3379 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:28.965613 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272df01a-4766-480c-83d4-9090ccdc3379 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:28.966050 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272df01a-4766-480c-83d4-9090ccdc3379 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:28.967634 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 680/1354] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 14:05:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:05:28.975820 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59942a-6cc1-4742-93b9-d5c5eeb2df14 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:28.976489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59942a-6cc1-4742-93b9-d5c5eeb2df14 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:28.976489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59942a-6cc1-4742-93b9-d5c5eeb2df14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:29.003766 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cf59942a-6cc1-4742-93b9-d5c5eeb2df14 None None] MFA Rules not processed for user `a758fc0f31ca40db96d0625dbb5d4c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:29.005938 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cf59942a-6cc1-4742-93b9-d5c5eeb2df14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:29.020326 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 675/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:33.001672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8a28a-8eff-4067-bb17-149d88cd9833 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:33.002533 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8a28a-8eff-4067-bb17-149d88cd9833 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:33.002968 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8a28a-8eff-4067-bb17-149d88cd9833 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:33.008916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 681/1356] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:33.010962 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a33c-d3f9-4af5-8dcf-03992784d926 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:33.011830 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a33c-d3f9-4af5-8dcf-03992784d926 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:33.012462 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a33c-d3f9-4af5-8dcf-03992784d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:33.032584 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b8e8a33c-d3f9-4af5-8dcf-03992784d926 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:33.034145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b8e8a33c-d3f9-4af5-8dcf-03992784d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:33.048808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 676/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:33.097897 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9f325-482e-4220-904e-c8a2aa6ec524 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:33.098257 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9f325-482e-4220-904e-c8a2aa6ec524 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:33.098508 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9f325-482e-4220-904e-c8a2aa6ec524 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:33.099802 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 682/1358] 10.222.0.13 () {54 vars in 961 bytes} [Mon May 16 14:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:33.106736 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265570-f219-4359-b8d6-fd553169b940 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:33.107342 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265570-f219-4359-b8d6-fd553169b940 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:33.107873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265570-f219-4359-b8d6-fd553169b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:33.167273 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a7265570-f219-4359-b8d6-fd553169b940 None None] MFA Rules not processed for user `c40d0702d56d47b48afc200b4de3027f`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:33.168653 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a7265570-f219-4359-b8d6-fd553169b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:33.274084 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 677/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Mon May 16 14:05:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:33.284005 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9f325-482e-4220-904e-c8a2aa6ec524 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:33.308915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9f325-482e-4220-904e-c8a2aa6ec524 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:33.315938 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87718044-d657-4d27-ad1b-85a6f8458f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:33.316914 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87718044-d657-4d27-ad1b-85a6f8458f68 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:33.317385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87718044-d657-4d27-ad1b-85a6f8458f68 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:33.317864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87718044-d657-4d27-ad1b-85a6f8458f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:33.329711 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87718044-d657-4d27-ad1b-85a6f8458f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:33.331474 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87718044-d657-4d27-ad1b-85a6f8458f68 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:33.344495 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 683/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:35.852074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755c869-7c04-4400-b9a1-d994af621074 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:35.852877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755c869-7c04-4400-b9a1-d994af621074 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:35.852877 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755c869-7c04-4400-b9a1-d994af621074 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:35.854265 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 678/1361] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:35.860318 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27d86-deca-4fb6-957c-cab539a8b4f0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:35.860892 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27d86-deca-4fb6-957c-cab539a8b4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:35.860892 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27d86-deca-4fb6-957c-cab539a8b4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:35.880439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-97d27d86-deca-4fb6-957c-cab539a8b4f0 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:35.881718 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-97d27d86-deca-4fb6-957c-cab539a8b4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:35.890928 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 684/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:35.936008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755c869-7c04-4400-b9a1-d994af621074 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:35.956730 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755c869-7c04-4400-b9a1-d994af621074 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:35.963202 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0474cf-adcd-404a-92f2-a8b0bfd3e72f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:35.964105 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0474cf-adcd-404a-92f2-a8b0bfd3e72f service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:35.964570 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0474cf-adcd-404a-92f2-a8b0bfd3e72f service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:35.965053 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0474cf-adcd-404a-92f2-a8b0bfd3e72f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:35.974489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0474cf-adcd-404a-92f2-a8b0bfd3e72f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:35.976415 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0474cf-adcd-404a-92f2-a8b0bfd3e72f service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:36.000917 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 679/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:38.580405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e800b-106a-419c-abaf-ccaa08da9e2f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:38.581015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e800b-106a-419c-abaf-ccaa08da9e2f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:38.581015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e800b-106a-419c-abaf-ccaa08da9e2f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:38.582415 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 685/1364] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:38.588802 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a276d0-834f-4977-8f6f-9ef25a0e0546 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:38.589541 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a276d0-834f-4977-8f6f-9ef25a0e0546 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:38.589541 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a276d0-834f-4977-8f6f-9ef25a0e0546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:38.608186 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-98a276d0-834f-4977-8f6f-9ef25a0e0546 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:38.609451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-98a276d0-834f-4977-8f6f-9ef25a0e0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:38.619247 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 680/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:38.667030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f63f-ab43-4b9b-a0eb-f8df71571364 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:38.667317 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f63f-ab43-4b9b-a0eb-f8df71571364 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:38.674070 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f63f-ab43-4b9b-a0eb-f8df71571364 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:38.675562 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 686/1366] 10.222.0.13 () {54 vars in 961 bytes} [Mon May 16 14:05:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:38.686530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d656a0-44d7-48c9-b604-f2956fcec642 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:38.686814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d656a0-44d7-48c9-b604-f2956fcec642 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:38.687766 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d656a0-44d7-48c9-b604-f2956fcec642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:38.706270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-08d656a0-44d7-48c9-b604-f2956fcec642 None None] MFA Rules not processed for user `c40d0702d56d47b48afc200b4de3027f`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:38.707473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-08d656a0-44d7-48c9-b604-f2956fcec642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:38.718541 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 681/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Mon May 16 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:38.728038 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850f63f-ab43-4b9b-a0eb-f8df71571364 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:38.743152 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850f63f-ab43-4b9b-a0eb-f8df71571364 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:38.748701 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42f148-1744-4a91-b517-94accd2694d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:38.749366 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42f148-1744-4a91-b517-94accd2694d0 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:38.749652 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42f148-1744-4a91-b517-94accd2694d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:38.749928 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42f148-1744-4a91-b517-94accd2694d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:38.760379 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42f148-1744-4a91-b517-94accd2694d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:38.763663 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42f148-1744-4a91-b517-94accd2694d0 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:38.782462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 687/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:41.177510 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3564-359a-41a1-b7ea-9298ee57a871 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:41.178095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3564-359a-41a1-b7ea-9298ee57a871 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:41.178095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3564-359a-41a1-b7ea-9298ee57a871 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:41.180302 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 682/1369] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:41.186617 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bf19-222d-408b-a406-247e7ea53852 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:41.187174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bf19-222d-408b-a406-247e7ea53852 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:41.187174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bf19-222d-408b-a406-247e7ea53852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:41.208295 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7369bf19-222d-408b-a406-247e7ea53852 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:41.210250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7369bf19-222d-408b-a406-247e7ea53852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:41.223142 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 688/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:41.268873 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a3564-359a-41a1-b7ea-9298ee57a871 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:41.284577 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a3564-359a-41a1-b7ea-9298ee57a871 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:41.291533 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2cab3-218f-4c4c-b483-f28f7c2a08b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:41.292193 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cab3-218f-4c4c-b483-f28f7c2a08b8 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:41.292483 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cab3-218f-4c4c-b483-f28f7c2a08b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:41.292850 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cab3-218f-4c4c-b483-f28f7c2a08b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:41.301884 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2cab3-218f-4c4c-b483-f28f7c2a08b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:41.303502 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2cab3-218f-4c4c-b483-f28f7c2a08b8 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:41.314054 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 683/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:41.710688 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26c68-31cb-410d-8000-a42e5c9a8193 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:41.711095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26c68-31cb-410d-8000-a42e5c9a8193 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:41.711307 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26c68-31cb-410d-8000-a42e5c9a8193 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:41.712907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 689/1372] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:41.718856 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648c986-b167-4d53-8864-3b77877347b1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:41.719142 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648c986-b167-4d53-8864-3b77877347b1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:41.719574 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648c986-b167-4d53-8864-3b77877347b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:41.738413 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9648c986-b167-4d53-8864-3b77877347b1 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:41.739717 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9648c986-b167-4d53-8864-3b77877347b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:41.749199 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 684/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:42.068053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde259bc-b94d-490c-921a-b26505a42eb6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:42.068053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde259bc-b94d-490c-921a-b26505a42eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:42.068053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde259bc-b94d-490c-921a-b26505a42eb6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:42.068545 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 690/1374] 10.222.0.13 () {54 vars in 963 bytes} [Mon May 16 14:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:42.074004 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049225c5-086b-4fd1-a2b5-8e7bc84187b3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:42.074291 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049225c5-086b-4fd1-a2b5-8e7bc84187b3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:42.074574 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049225c5-086b-4fd1-a2b5-8e7bc84187b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:42.126038 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-049225c5-086b-4fd1-a2b5-8e7bc84187b3 None None] MFA Rules not processed for user `7821fd86364744bf9d79e03d32b749fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:42.127276 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-049225c5-086b-4fd1-a2b5-8e7bc84187b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:42.191432 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 685/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Mon May 16 14:05:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:42.205660 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde259bc-b94d-490c-921a-b26505a42eb6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:42.217839 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde259bc-b94d-490c-921a-b26505a42eb6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:42.222093 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b453cd-3ad5-4b9d-8bd4-70ca04015b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7821fd86364744bf9d79e03d32b749fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:42.222853 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b453cd-3ad5-4b9d-8bd4-70ca04015b0e service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:42.223232 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b453cd-3ad5-4b9d-8bd4-70ca04015b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:42.223606 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b453cd-3ad5-4b9d-8bd4-70ca04015b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:42.236413 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b453cd-3ad5-4b9d-8bd4-70ca04015b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:42.239269 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b453cd-3ad5-4b9d-8bd4-70ca04015b0e service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:42.251182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 691/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 14:05:43.689103 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903aabb-2fe8-422b-b6e7-bb1f952c58bb None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:43.689671 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903aabb-2fe8-422b-b6e7-bb1f952c58bb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:43.689671 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903aabb-2fe8-422b-b6e7-bb1f952c58bb None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:43.691092 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 686/1377] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:43.697015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682a7a-ede8-45f8-b259-b2cee3adf0e4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:43.697569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682a7a-ede8-45f8-b259-b2cee3adf0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:43.697569 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682a7a-ede8-45f8-b259-b2cee3adf0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:43.718172 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-93682a7a-ede8-45f8-b259-b2cee3adf0e4 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:43.719405 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-93682a7a-ede8-45f8-b259-b2cee3adf0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:43.728849 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 692/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:43.776072 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903aabb-2fe8-422b-b6e7-bb1f952c58bb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:43.791419 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903aabb-2fe8-422b-b6e7-bb1f952c58bb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:43.797472 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1259a-943d-497b-9053-9be849edc72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:43.798133 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1259a-943d-497b-9053-9be849edc72a service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:43.798417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1259a-943d-497b-9053-9be849edc72a service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:43.798693 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1259a-943d-497b-9053-9be849edc72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:43.809514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1259a-943d-497b-9053-9be849edc72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:43.811154 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1259a-943d-497b-9053-9be849edc72a service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:43.823828 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 687/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:46.221139 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c459a21-0b82-454d-ae4a-43dedc658c32 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:46.221987 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c459a21-0b82-454d-ae4a-43dedc658c32 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:46.222541 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c459a21-0b82-454d-ae4a-43dedc658c32 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:46.226037 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 693/1380] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:46.235392 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71778007-8e12-4475-8b35-0b2198df6f6a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:46.236194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71778007-8e12-4475-8b35-0b2198df6f6a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:46.236709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71778007-8e12-4475-8b35-0b2198df6f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:46.267187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-71778007-8e12-4475-8b35-0b2198df6f6a None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:46.269194 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-71778007-8e12-4475-8b35-0b2198df6f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:46.282644 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 688/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:05:46.350385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c459a21-0b82-454d-ae4a-43dedc658c32 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:46.367437 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c459a21-0b82-454d-ae4a-43dedc658c32 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:46.374527 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf78f-a611-412b-a6cb-9657d005399c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:46.375182 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf78f-a611-412b-a6cb-9657d005399c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:46.375470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf78f-a611-412b-a6cb-9657d005399c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:46.375747 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf78f-a611-412b-a6cb-9657d005399c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:46.386542 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf78f-a611-412b-a6cb-9657d005399c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:46.388149 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf78f-a611-412b-a6cb-9657d005399c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:46.407955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 694/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 14:05:48.861675 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814a25-760f-4cce-aec2-806d93ed9452 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:48.862261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814a25-760f-4cce-aec2-806d93ed9452 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:48.862261 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814a25-760f-4cce-aec2-806d93ed9452 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:48.863924 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 689/1383] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:48.869392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2883f1-09c2-4fcd-8f22-6bfb213efd37 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:48.869889 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2883f1-09c2-4fcd-8f22-6bfb213efd37 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:48.870014 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2883f1-09c2-4fcd-8f22-6bfb213efd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:48.889060 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7a2883f1-09c2-4fcd-8f22-6bfb213efd37 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:48.890477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7a2883f1-09c2-4fcd-8f22-6bfb213efd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:48.909268 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 695/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:48.950818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3814a25-760f-4cce-aec2-806d93ed9452 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:48.967792 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3814a25-760f-4cce-aec2-806d93ed9452 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:48.973946 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf70f0-b019-4b5a-a755-ccfbc510b218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:48.974610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf70f0-b019-4b5a-a755-ccfbc510b218 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:48.974895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf70f0-b019-4b5a-a755-ccfbc510b218 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:48.975168 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf70f0-b019-4b5a-a755-ccfbc510b218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:48.984846 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf70f0-b019-4b5a-a755-ccfbc510b218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:48.986709 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf70f0-b019-4b5a-a755-ccfbc510b218 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:48.999530 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 690/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:51.370882 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b15ec-bb27-46ff-814d-a5cba7bdfed1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:51.371456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b15ec-bb27-46ff-814d-a5cba7bdfed1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:51.371456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b15ec-bb27-46ff-814d-a5cba7bdfed1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:51.372973 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 696/1386] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:51.383087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa009-ba9e-406a-95e6-03263b6c2987 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:51.383637 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa009-ba9e-406a-95e6-03263b6c2987 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:51.383637 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa009-ba9e-406a-95e6-03263b6c2987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:51.403112 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8b1fa009-ba9e-406a-95e6-03263b6c2987 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:51.404330 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8b1fa009-ba9e-406a-95e6-03263b6c2987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:51.412560 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 691/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:51.458411 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b15ec-bb27-46ff-814d-a5cba7bdfed1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:51.473753 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b15ec-bb27-46ff-814d-a5cba7bdfed1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:51.479577 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e98418-50bc-49e9-b5c5-553bac65907c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:51.480230 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e98418-50bc-49e9-b5c5-553bac65907c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:51.480703 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e98418-50bc-49e9-b5c5-553bac65907c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:51.481143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e98418-50bc-49e9-b5c5-553bac65907c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:51.491725 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e98418-50bc-49e9-b5c5-553bac65907c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:51.493385 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e98418-50bc-49e9-b5c5-553bac65907c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:51.504449 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 697/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:53.811704 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1308a-bd17-4c34-9732-197ea4f6993e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:53.812266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1308a-bd17-4c34-9732-197ea4f6993e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:53.812266 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1308a-bd17-4c34-9732-197ea4f6993e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:53.813649 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 692/1389] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:53.819923 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999442-509e-4374-a30a-5dd4817c069d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:53.820735 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999442-509e-4374-a30a-5dd4817c069d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:53.821242 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999442-509e-4374-a30a-5dd4817c069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:53.851915 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-54999442-509e-4374-a30a-5dd4817c069d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:53.853678 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54999442-509e-4374-a30a-5dd4817c069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:53.864487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 698/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:53.910270 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1308a-bd17-4c34-9732-197ea4f6993e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:53.927512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1308a-bd17-4c34-9732-197ea4f6993e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:53.934654 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db257de-62a8-43a3-a2d0-24f97c205e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:53.935708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db257de-62a8-43a3-a2d0-24f97c205e7a service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:53.936171 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db257de-62a8-43a3-a2d0-24f97c205e7a service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:53.936601 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db257de-62a8-43a3-a2d0-24f97c205e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:53.950087 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db257de-62a8-43a3-a2d0-24f97c205e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:53.952291 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db257de-62a8-43a3-a2d0-24f97c205e7a service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:53.965940 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 693/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:56.256532 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8840-7ab3-4c06-8fb9-cb8a88f0debf None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:56.257152 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8840-7ab3-4c06-8fb9-cb8a88f0debf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:56.257152 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8840-7ab3-4c06-8fb9-cb8a88f0debf None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:56.258525 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 699/1392] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:56.263993 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5caeab-d519-45fb-8290-f4a9183e40f3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:56.264480 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5caeab-d519-45fb-8290-f4a9183e40f3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:56.264593 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5caeab-d519-45fb-8290-f4a9183e40f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:56.284074 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3d5caeab-d519-45fb-8290-f4a9183e40f3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:56.285315 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3d5caeab-d519-45fb-8290-f4a9183e40f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:56.293238 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 694/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:56.339344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8840-7ab3-4c06-8fb9-cb8a88f0debf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:56.354390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8840-7ab3-4c06-8fb9-cb8a88f0debf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:56.359972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4b65d-431c-4177-8610-a9941dc9fc32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:56.360611 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b65d-431c-4177-8610-a9941dc9fc32 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:56.360921 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b65d-431c-4177-8610-a9941dc9fc32 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:56.361188 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b65d-431c-4177-8610-a9941dc9fc32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:56.370057 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4b65d-431c-4177-8610-a9941dc9fc32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:56.371626 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4b65d-431c-4177-8610-a9941dc9fc32 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:56.382427 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 700/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:58.435759 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5cb5-f5ed-45a8-a9e4-128e58fb0220 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:58.435759 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5cb5-f5ed-45a8-a9e4-128e58fb0220 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:58.437884 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5cb5-f5ed-45a8-a9e4-128e58fb0220 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:58.438033 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 695/1395] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:58.443775 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75dfa-8554-4350-babc-83f3e7694b04 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:58.444579 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75dfa-8554-4350-babc-83f3e7694b04 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:58.444799 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75dfa-8554-4350-babc-83f3e7694b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:58.469315 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-17e75dfa-8554-4350-babc-83f3e7694b04 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:58.471696 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-17e75dfa-8554-4350-babc-83f3e7694b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:58.480735 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 701/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:58.544381 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a91b5d-ca7c-4045-bc29-69c3a2d06856 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:58.544684 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a91b5d-ca7c-4045-bc29-69c3a2d06856 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:58.545450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a91b5d-ca7c-4045-bc29-69c3a2d06856 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:58.547141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 696/1397] 10.222.0.13 () {54 vars in 962 bytes} [Mon May 16 14:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:58.553448 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb7e7a-4959-4c6a-b8c3-4c2eeefc465d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:58.553785 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb7e7a-4959-4c6a-b8c3-4c2eeefc465d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:58.554006 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb7e7a-4959-4c6a-b8c3-4c2eeefc465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:58.612595 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c4bb7e7a-4959-4c6a-b8c3-4c2eeefc465d None None] MFA Rules not processed for user `6c6aec0d7c7d4904a07bb4b812514701`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:58.613864 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c4bb7e7a-4959-4c6a-b8c3-4c2eeefc465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:58.686485 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 702/1398] 10.222.0.13 () {58 vars in 1059 bytes} [Mon May 16 14:05:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:58.695047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a91b5d-ca7c-4045-bc29-69c3a2d06856 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:58.701920 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214f33-c828-4cc4-8a6d-33a7873f6a16 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:58.702531 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214f33-c828-4cc4-8a6d-33a7873f6a16 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:58.703098 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214f33-c828-4cc4-8a6d-33a7873f6a16 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:58.705220 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 703/1399] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:05:58.708458 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a91b5d-ca7c-4045-bc29-69c3a2d06856 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:58.710813 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1956f8-2c81-4948-bc5b-daf1aae08737 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:58.711115 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1956f8-2c81-4948-bc5b-daf1aae08737 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:58.711441 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1956f8-2c81-4948-bc5b-daf1aae08737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:58.713116 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104c963-e348-4d59-a16f-b8c045970eba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c6aec0d7c7d4904a07bb4b812514701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:58.713776 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c963-e348-4d59-a16f-b8c045970eba service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:58.714068 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c963-e348-4d59-a16f-b8c045970eba service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:58.714340 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c963-e348-4d59-a16f-b8c045970eba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:58.726970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104c963-e348-4d59-a16f-b8c045970eba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:58.728409 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104c963-e348-4d59-a16f-b8c045970eba service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:58.730383 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3e1956f8-2c81-4948-bc5b-daf1aae08737 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:58.731574 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3e1956f8-2c81-4948-bc5b-daf1aae08737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:58.739248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 697/1400] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:58.741192 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 704/1401] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:58.786915 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104c963-e348-4d59-a16f-b8c045970eba service glance] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:58.799517 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104c963-e348-4d59-a16f-b8c045970eba service glance] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:58.805148 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bd409-de57-4446-9a30-e29d653fd497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:58.805880 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd409-de57-4446-9a30-e29d653fd497 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:58.806230 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd409-de57-4446-9a30-e29d653fd497 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:58.806576 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd409-de57-4446-9a30-e29d653fd497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:58.815550 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bd409-de57-4446-9a30-e29d653fd497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:58.817306 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bd409-de57-4446-9a30-e29d653fd497 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:58.827808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 698/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:05:59.206134 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e385e2-4bbd-4f3a-8b13-bc101b0f2802 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:59.206420 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e385e2-4bbd-4f3a-8b13-bc101b0f2802 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:59.206706 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e385e2-4bbd-4f3a-8b13-bc101b0f2802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:59.265506 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-62e385e2-4bbd-4f3a-8b13-bc101b0f2802 None None] MFA Rules not processed for user `7616958327124128a02166a27c462312`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:59.267273 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62e385e2-4bbd-4f3a-8b13-bc101b0f2802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:59.333883 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 705/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 14:05:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:59.377540 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12046a5e-e88b-4425-aa59-dd449179ec60 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:59.377810 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12046a5e-e88b-4425-aa59-dd449179ec60 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:59.378078 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12046a5e-e88b-4425-aa59-dd449179ec60 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:59.379450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 699/1404] 10.222.0.13 () {54 vars in 942 bytes} [Mon May 16 14:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:05:59.386179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60add249-d3de-4736-8a23-99c2b43d415b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:59.386460 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60add249-d3de-4736-8a23-99c2b43d415b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:59.386736 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60add249-d3de-4736-8a23-99c2b43d415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:59.443407 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-60add249-d3de-4736-8a23-99c2b43d415b None None] MFA Rules not processed for user `0734d46e1f4c4994a03d56f0591dfded`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:05:59.445034 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-60add249-d3de-4736-8a23-99c2b43d415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:05:59.527015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 706/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Mon May 16 14:05:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:05:59.537259 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12046a5e-e88b-4425-aa59-dd449179ec60 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:05:59.552119 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12046a5e-e88b-4425-aa59-dd449179ec60 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:05:59.558377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef4e6-3df6-4b87-8413-f288d2e6f46b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0734d46e1f4c4994a03d56f0591dfded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:05:59.559033 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef4e6-3df6-4b87-8413-f288d2e6f46b service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:05:59.559321 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef4e6-3df6-4b87-8413-f288d2e6f46b service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:05:59.559599 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef4e6-3df6-4b87-8413-f288d2e6f46b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:05:59.569692 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cef4e6-3df6-4b87-8413-f288d2e6f46b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:05:59.571296 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cef4e6-3df6-4b87-8413-f288d2e6f46b service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:05:59.580049 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 700/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 14:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 14:06:01.238282 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35338-f5a5-4b82-9426-f36fbfbc3de4 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:01.239164 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35338-f5a5-4b82-9426-f36fbfbc3de4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:01.239598 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35338-f5a5-4b82-9426-f36fbfbc3de4 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:01.241328 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 707/1407] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:01.247214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3bc86-fa8e-485c-8f21-8403a8622214 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:01.247984 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3bc86-fa8e-485c-8f21-8403a8622214 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:01.247984 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3bc86-fa8e-485c-8f21-8403a8622214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:01.269723 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-45c3bc86-fa8e-485c-8f21-8403a8622214 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:01.271757 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-45c3bc86-fa8e-485c-8f21-8403a8622214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:01.280546 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 701/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:06:01.327723 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b35338-f5a5-4b82-9426-f36fbfbc3de4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:01.345348 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b35338-f5a5-4b82-9426-f36fbfbc3de4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:01.351449 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ec4e2-f1e7-4afc-a099-ce250f699968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:01.352095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec4e2-f1e7-4afc-a099-ce250f699968 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:01.352584 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec4e2-f1e7-4afc-a099-ce250f699968 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:01.352877 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec4e2-f1e7-4afc-a099-ce250f699968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:01.362609 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ec4e2-f1e7-4afc-a099-ce250f699968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:01.364481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ec4e2-f1e7-4afc-a099-ce250f699968 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:01.374652 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 708/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:23.925855 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b736b0-ce9b-4a08-ace4-5e5703f971e5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:23.926491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b736b0-ce9b-4a08-ace4-5e5703f971e5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:23.926491 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b736b0-ce9b-4a08-ace4-5e5703f971e5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:23.927782 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 702/1410] 10.222.0.13 () {54 vars in 918 bytes} [Mon May 16 14:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:23.934468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cf672-2f11-4644-85fa-078f17238466 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:23.935041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cf672-2f11-4644-85fa-078f17238466 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:23.935041 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cf672-2f11-4644-85fa-078f17238466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:23.954475 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-455cf672-2f11-4644-85fa-078f17238466 None None] MFA Rules not processed for user `a758fc0f31ca40db96d0625dbb5d4c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:23.955674 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-455cf672-2f11-4644-85fa-078f17238466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:23.964932 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 709/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Mon May 16 14:06:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:06:23.981628 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3904-1db2-4736-b22d-47393a0ad9e5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:23.981913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3904-1db2-4736-b22d-47393a0ad9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:23.982187 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3904-1db2-4736-b22d-47393a0ad9e5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:23.983558 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 703/1412] 10.222.0.13 () {54 vars in 918 bytes} [Mon May 16 14:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:23.988788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568de1-5245-4dcb-9980-bd8ff0acad7b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:23.989075 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568de1-5245-4dcb-9980-bd8ff0acad7b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:23.989348 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568de1-5245-4dcb-9980-bd8ff0acad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:24.010374 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d6568de1-5245-4dcb-9980-bd8ff0acad7b None None] MFA Rules not processed for user `c40d0702d56d47b48afc200b4de3027f`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:24.012465 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d6568de1-5245-4dcb-9980-bd8ff0acad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:24.021778 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 710/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Mon May 16 14:06:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:26.809020 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa725b8-4f7e-46a0-9236-b1800c284d66 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:26.809618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa725b8-4f7e-46a0-9236-b1800c284d66 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:26.809618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa725b8-4f7e-46a0-9236-b1800c284d66 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:26.810958 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:26.816820 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0e64-bfde-4a30-8d1d-8c64149fed95 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:26.817344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0e64-bfde-4a30-8d1d-8c64149fed95 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:26.817455 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0e64-bfde-4a30-8d1d-8c64149fed95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:26.836147 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5fce0e64-bfde-4a30-8d1d-8c64149fed95 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:26.837362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5fce0e64-bfde-4a30-8d1d-8c64149fed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:26.845716 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:26.892608 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa725b8-4f7e-46a0-9236-b1800c284d66 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:26.908210 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa725b8-4f7e-46a0-9236-b1800c284d66 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:26.913859 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4b5ad-ae9a-4d28-b7d0-ffb5470500de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:26.914534 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b5ad-ae9a-4d28-b7d0-ffb5470500de service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:26.914818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b5ad-ae9a-4d28-b7d0-ffb5470500de service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:26.915095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b5ad-ae9a-4d28-b7d0-ffb5470500de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:26.923980 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4b5ad-ae9a-4d28-b7d0-ffb5470500de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:26.925605 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4b5ad-ae9a-4d28-b7d0-ffb5470500de service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:26.935565 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 705/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:27.982442 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284adcb-645f-4563-9929-28de8d4536e3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:27.983009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284adcb-645f-4563-9929-28de8d4536e3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:27.983009 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284adcb-645f-4563-9929-28de8d4536e3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:27.984363 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 14:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:06:27.990147 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36d54-e64a-4af4-9f08-1e3577326ec0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:27.990773 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36d54-e64a-4af4-9f08-1e3577326ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:27.990773 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36d54-e64a-4af4-9f08-1e3577326ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:28.011424 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e7b36d54-e64a-4af4-9f08-1e3577326ec0 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:28.012817 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e7b36d54-e64a-4af4-9f08-1e3577326ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:28.022170 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 14:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:28.186310 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284adcb-645f-4563-9929-28de8d4536e3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:28.202344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284adcb-645f-4563-9929-28de8d4536e3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:28.208193 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bac6e-292f-443d-bfb5-9d364d28a22e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:28.208859 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bac6e-292f-443d-bfb5-9d364d28a22e service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:28.209143 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bac6e-292f-443d-bfb5-9d364d28a22e service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:28.209416 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bac6e-292f-443d-bfb5-9d364d28a22e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:28.218517 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bac6e-292f-443d-bfb5-9d364d28a22e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:28.220131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bac6e-292f-443d-bfb5-9d364d28a22e service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:28.231627 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 713/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:29.231862 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7ba5-6c1e-45f4-b138-ea89ed92f17f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:29.232384 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7ba5-6c1e-45f4-b138-ea89ed92f17f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:29.232384 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7ba5-6c1e-45f4-b138-ea89ed92f17f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:29.233746 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 14:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:29.239390 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926033-b293-4e80-b2db-e2c0cfb97121 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:29.239884 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926033-b293-4e80-b2db-e2c0cfb97121 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:29.240023 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926033-b293-4e80-b2db-e2c0cfb97121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:29.259510 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bf926033-b293-4e80-b2db-e2c0cfb97121 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:29.261319 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bf926033-b293-4e80-b2db-e2c0cfb97121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:29.269539 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 14:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:29.436086 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a7ba5-6c1e-45f4-b138-ea89ed92f17f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:29.453382 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a7ba5-6c1e-45f4-b138-ea89ed92f17f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:29.459968 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c59db-1fbd-49bb-b43a-460d9b142796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:29.460831 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c59db-1fbd-49bb-b43a-460d9b142796 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:29.461161 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c59db-1fbd-49bb-b43a-460d9b142796 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:29.461483 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c59db-1fbd-49bb-b43a-460d9b142796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:29.472665 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c59db-1fbd-49bb-b43a-460d9b142796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:29.474405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c59db-1fbd-49bb-b43a-460d9b142796 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:29.486610 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 708/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:30.436902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562c8a-3485-4e23-a4de-c6c1ebdbfa1a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:30.437456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562c8a-3485-4e23-a4de-c6c1ebdbfa1a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:30.437456 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562c8a-3485-4e23-a4de-c6c1ebdbfa1a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:30.438830 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 14:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:30.444271 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db9ad9-6417-49b0-bb7c-deacb7fd52a6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:30.444803 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db9ad9-6417-49b0-bb7c-deacb7fd52a6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:30.444913 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db9ad9-6417-49b0-bb7c-deacb7fd52a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:30.465005 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b4db9ad9-6417-49b0-bb7c-deacb7fd52a6 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:30.466222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b4db9ad9-6417-49b0-bb7c-deacb7fd52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:30.474246 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 14:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:30.633233 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe562c8a-3485-4e23-a4de-c6c1ebdbfa1a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:30.647521 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe562c8a-3485-4e23-a4de-c6c1ebdbfa1a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:30.652873 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6855e3c-94a1-4c53-b630-e934b652f110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:30.653512 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855e3c-94a1-4c53-b630-e934b652f110 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:30.653788 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855e3c-94a1-4c53-b630-e934b652f110 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:30.654053 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855e3c-94a1-4c53-b630-e934b652f110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:30.662480 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6855e3c-94a1-4c53-b630-e934b652f110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:30.664049 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6855e3c-94a1-4c53-b630-e934b652f110 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:30.674487 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 716/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:31.631789 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0187-dafe-4cbb-b366-c20df0a00467 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:31.632362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0187-dafe-4cbb-b366-c20df0a00467 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:31.632362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0187-dafe-4cbb-b366-c20df0a00467 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:31.633858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 14:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:31.640630 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0ace3-9c70-4f81-818f-17082ab28664 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:31.641489 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0ace3-9c70-4f81-818f-17082ab28664 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:31.641699 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0ace3-9c70-4f81-818f-17082ab28664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:31.660184 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fdb0ace3-9c70-4f81-818f-17082ab28664 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:31.661392 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fdb0ace3-9c70-4f81-818f-17082ab28664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:31.669408 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 14:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:31.819495 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f0187-dafe-4cbb-b366-c20df0a00467 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:31.834405 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f0187-dafe-4cbb-b366-c20df0a00467 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:31.840248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5d18-cd1b-46f3-8da7-74885d3bf54b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:31.840930 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5d18-cd1b-46f3-8da7-74885d3bf54b service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:31.841214 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5d18-cd1b-46f3-8da7-74885d3bf54b service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:31.841489 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5d18-cd1b-46f3-8da7-74885d3bf54b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:31.850245 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d5d18-cd1b-46f3-8da7-74885d3bf54b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:31.851995 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d5d18-cd1b-46f3-8da7-74885d3bf54b service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:31.862022 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 711/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:32.757091 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e8fba-1eb5-4cec-9eea-551ccd6760ac None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:32.757752 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e8fba-1eb5-4cec-9eea-551ccd6760ac None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:32.757752 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e8fba-1eb5-4cec-9eea-551ccd6760ac None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:32.759580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 14:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:32.765225 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273190-44fd-419e-b0c0-becc0861d04d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:32.766015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273190-44fd-419e-b0c0-becc0861d04d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:32.766193 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273190-44fd-419e-b0c0-becc0861d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:32.784129 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-22273190-44fd-419e-b0c0-becc0861d04d None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:32.785362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-22273190-44fd-419e-b0c0-becc0861d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:32.793876 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:32.948710 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e8fba-1eb5-4cec-9eea-551ccd6760ac None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:32.963356 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e8fba-1eb5-4cec-9eea-551ccd6760ac None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:32.968695 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249089c-acd3-45cb-a94a-09ce9b466b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:32.969362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249089c-acd3-45cb-a94a-09ce9b466b7c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:32.969637 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249089c-acd3-45cb-a94a-09ce9b466b7c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:32.969907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249089c-acd3-45cb-a94a-09ce9b466b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:32.978964 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249089c-acd3-45cb-a94a-09ce9b466b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:32.980541 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249089c-acd3-45cb-a94a-09ce9b466b7c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:32.990248 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 719/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:33.909514 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e9d7-4215-46df-b09c-65e74ffb8734 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:33.910134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e9d7-4215-46df-b09c-65e74ffb8734 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:33.910134 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e9d7-4215-46df-b09c-65e74ffb8734 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:33.911577 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 14:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:33.917809 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd663c-bb26-4b94-800f-ea0d050cf1e1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:33.918459 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd663c-bb26-4b94-800f-ea0d050cf1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:33.918459 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd663c-bb26-4b94-800f-ea0d050cf1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:33.939175 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-90bd663c-bb26-4b94-800f-ea0d050cf1e1 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:33.940468 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-90bd663c-bb26-4b94-800f-ea0d050cf1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:33.950087 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 14:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:34.103967 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5e9d7-4215-46df-b09c-65e74ffb8734 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:34.118622 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5e9d7-4215-46df-b09c-65e74ffb8734 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:34.124160 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a536087-8d27-42a5-bfcb-11de20cb58db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:34.124851 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536087-8d27-42a5-bfcb-11de20cb58db service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:34.125132 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536087-8d27-42a5-bfcb-11de20cb58db service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:34.125410 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536087-8d27-42a5-bfcb-11de20cb58db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:34.135258 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a536087-8d27-42a5-bfcb-11de20cb58db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:34.136872 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a536087-8d27-42a5-bfcb-11de20cb58db service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:34.147042 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 714/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:35.109642 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2543-7279-48e0-9258-f5d04ff00e7f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:35.110250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2543-7279-48e0-9258-f5d04ff00e7f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:35.110250 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2543-7279-48e0-9258-f5d04ff00e7f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:35.111543 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 14:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:35.118454 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734720-9f5f-474d-9297-31a49840f5e6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:35.119062 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734720-9f5f-474d-9297-31a49840f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:35.119417 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734720-9f5f-474d-9297-31a49840f5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:35.151948 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e7734720-9f5f-474d-9297-31a49840f5e6 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:35.153976 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e7734720-9f5f-474d-9297-31a49840f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:35.164618 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:35.330292 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2543-7279-48e0-9258-f5d04ff00e7f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:35.344872 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2543-7279-48e0-9258-f5d04ff00e7f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:35.350966 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfde798-f11d-4096-a2a9-b3090dcf770f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:35.351628 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde798-f11d-4096-a2a9-b3090dcf770f service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:35.351907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde798-f11d-4096-a2a9-b3090dcf770f service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:35.352183 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde798-f11d-4096-a2a9-b3090dcf770f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:35.361576 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfde798-f11d-4096-a2a9-b3090dcf770f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:35.363174 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfde798-f11d-4096-a2a9-b3090dcf770f service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:35.374672 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 722/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:36.301116 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc5a7f-794c-4b5e-bf25-d7335aef475b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:36.301977 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc5a7f-794c-4b5e-bf25-d7335aef475b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:36.301977 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc5a7f-794c-4b5e-bf25-d7335aef475b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:36.303046 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 14:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:06:36.309439 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fb628-980a-45b8-8267-44068ceea580 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:36.309981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fb628-980a-45b8-8267-44068ceea580 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:36.309981 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fb628-980a-45b8-8267-44068ceea580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:36.330811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bf0fb628-980a-45b8-8267-44068ceea580 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:36.332015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bf0fb628-980a-45b8-8267-44068ceea580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:36.340293 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:36.495383 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc5a7f-794c-4b5e-bf25-d7335aef475b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:36.510747 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc5a7f-794c-4b5e-bf25-d7335aef475b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:36.516989 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1221a3-80a2-4b84-aeb7-7bafa561a9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:36.517677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1221a3-80a2-4b84-aeb7-7bafa561a9ee service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:36.517959 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1221a3-80a2-4b84-aeb7-7bafa561a9ee service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:36.518237 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1221a3-80a2-4b84-aeb7-7bafa561a9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:36.528639 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1221a3-80a2-4b84-aeb7-7bafa561a9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:36.530267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1221a3-80a2-4b84-aeb7-7bafa561a9ee service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:36.541139 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 717/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:38.707412 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fec3-84f8-4a11-8443-005fc4f4fad1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:38.707999 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fec3-84f8-4a11-8443-005fc4f4fad1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:38.707999 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fec3-84f8-4a11-8443-005fc4f4fad1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:38.709515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:38.715377 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc829c-3a39-4c2e-8703-6c89d43d7d0f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:38.715916 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc829c-3a39-4c2e-8703-6c89d43d7d0f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:38.716007 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc829c-3a39-4c2e-8703-6c89d43d7d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:38.734656 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4ccc829c-3a39-4c2e-8703-6c89d43d7d0f None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:38.735869 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4ccc829c-3a39-4c2e-8703-6c89d43d7d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:38.744706 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:38.785671 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fec3-84f8-4a11-8443-005fc4f4fad1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:38.797452 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fec3-84f8-4a11-8443-005fc4f4fad1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:38.801166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881e2ae-f836-4b4f-a49f-0e83bb25ba8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:38.801847 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e2ae-f836-4b4f-a49f-0e83bb25ba8e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:38.802136 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e2ae-f836-4b4f-a49f-0e83bb25ba8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:38.802421 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e2ae-f836-4b4f-a49f-0e83bb25ba8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:38.813640 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881e2ae-f836-4b4f-a49f-0e83bb25ba8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:38.815126 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881e2ae-f836-4b4f-a49f-0e83bb25ba8e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:38.826179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 725/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:41.312106 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6821cf-c14a-44cc-8646-b9e468a2f895 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:41.312721 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6821cf-c14a-44cc-8646-b9e468a2f895 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:41.312880 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6821cf-c14a-44cc-8646-b9e468a2f895 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:41.314314 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:41.321358 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb5ea0-fcb0-406e-9656-f6a2866d75b1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:41.322179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb5ea0-fcb0-406e-9656-f6a2866d75b1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:41.322179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb5ea0-fcb0-406e-9656-f6a2866d75b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:41.340972 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d9eb5ea0-fcb0-406e-9656-f6a2866d75b1 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:41.342197 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d9eb5ea0-fcb0-406e-9656-f6a2866d75b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:41.350397 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:41.392110 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6821cf-c14a-44cc-8646-b9e468a2f895 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:41.403520 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6821cf-c14a-44cc-8646-b9e468a2f895 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:41.407243 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8441e-57e7-4317-a59f-5838e0c43067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:41.407895 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8441e-57e7-4317-a59f-5838e0c43067 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:41.408178 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8441e-57e7-4317-a59f-5838e0c43067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:41.408456 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8441e-57e7-4317-a59f-5838e0c43067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:41.418667 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8441e-57e7-4317-a59f-5838e0c43067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:41.420108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8441e-57e7-4317-a59f-5838e0c43067 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:41.431264 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 720/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:44.162956 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648c6e-c33a-48ab-8049-8da65f140a15 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:44.164048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648c6e-c33a-48ab-8049-8da65f140a15 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:44.164048 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648c6e-c33a-48ab-8049-8da65f140a15 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:44.165314 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:06:44.170983 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6313e1-7325-434b-926b-e67c8e84776c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:44.171427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6313e1-7325-434b-926b-e67c8e84776c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:44.171557 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6313e1-7325-434b-926b-e67c8e84776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:44.189783 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cf6313e1-7325-434b-926b-e67c8e84776c None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:44.191003 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cf6313e1-7325-434b-926b-e67c8e84776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:44.199295 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:06:44.242860 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d648c6e-c33a-48ab-8049-8da65f140a15 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:44.253857 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d648c6e-c33a-48ab-8049-8da65f140a15 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:44.258119 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08e530-a36a-4a15-94b3-9d98b3bf58ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:44.258754 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e530-a36a-4a15-94b3-9d98b3bf58ae service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:44.259032 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e530-a36a-4a15-94b3-9d98b3bf58ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:44.259304 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e530-a36a-4a15-94b3-9d98b3bf58ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:44.268470 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08e530-a36a-4a15-94b3-9d98b3bf58ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:44.269916 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08e530-a36a-4a15-94b3-9d98b3bf58ae service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:44.280003 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 728/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:46.690222 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7bc3-d31f-4fcb-9f5f-823539246a65 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:46.690818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7bc3-d31f-4fcb-9f5f-823539246a65 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:46.690818 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7bc3-d31f-4fcb-9f5f-823539246a65 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:46.692252 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:46.699211 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384900f-41fb-4d66-bc1d-28253e342bdb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:46.699743 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384900f-41fb-4d66-bc1d-28253e342bdb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:46.699743 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384900f-41fb-4d66-bc1d-28253e342bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:46.718826 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f384900f-41fb-4d66-bc1d-28253e342bdb None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:46.720028 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f384900f-41fb-4d66-bc1d-28253e342bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:46.729641 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:06:46.768945 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c7bc3-d31f-4fcb-9f5f-823539246a65 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:46.780017 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c7bc3-d31f-4fcb-9f5f-823539246a65 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:46.783616 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f7922-6164-44dd-897c-e186316929df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:46.784259 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7922-6164-44dd-897c-e186316929df service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:46.784543 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7922-6164-44dd-897c-e186316929df service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:46.784858 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7922-6164-44dd-897c-e186316929df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:46.795020 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f7922-6164-44dd-897c-e186316929df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:46.796451 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f7922-6164-44dd-897c-e186316929df service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:46.806567 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 723/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:49.304015 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cef179-f8cd-425e-9e4b-f82b61d2c325 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:49.304653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cef179-f8cd-425e-9e4b-f82b61d2c325 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:49.304653 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cef179-f8cd-425e-9e4b-f82b61d2c325 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:49.306058 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:49.311532 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d857-205b-4d15-9bf6-978648d6268f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:49.312008 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d857-205b-4d15-9bf6-978648d6268f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:49.312115 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d857-205b-4d15-9bf6-978648d6268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:49.329814 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5202d857-205b-4d15-9bf6-978648d6268f None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:49.331001 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5202d857-205b-4d15-9bf6-978648d6268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:49.338845 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:49.378447 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cef179-f8cd-425e-9e4b-f82b61d2c325 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:49.389770 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cef179-f8cd-425e-9e4b-f82b61d2c325 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:49.393256 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd74b5-6645-47ea-b9d2-374cea88d77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:49.393896 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd74b5-6645-47ea-b9d2-374cea88d77c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:49.394173 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd74b5-6645-47ea-b9d2-374cea88d77c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:49.394443 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd74b5-6645-47ea-b9d2-374cea88d77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:49.404335 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd74b5-6645-47ea-b9d2-374cea88d77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:49.405828 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd74b5-6645-47ea-b9d2-374cea88d77c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:49.415420 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 731/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:51.823181 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075a0b-8858-43cd-8565-102d4df52d10 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:51.823757 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075a0b-8858-43cd-8565-102d4df52d10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:51.823757 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075a0b-8858-43cd-8565-102d4df52d10 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:51.825327 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:51.830705 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431eb68-8bfd-480b-9cdc-f05f20587d93 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:51.831271 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431eb68-8bfd-480b-9cdc-f05f20587d93 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:51.831271 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431eb68-8bfd-480b-9cdc-f05f20587d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:51.851105 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c431eb68-8bfd-480b-9cdc-f05f20587d93 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:51.852885 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c431eb68-8bfd-480b-9cdc-f05f20587d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:51.861902 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:51.901278 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a075a0b-8858-43cd-8565-102d4df52d10 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:51.918146 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a075a0b-8858-43cd-8565-102d4df52d10 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:51.922051 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a0684-8978-4e88-809e-50ae88a64134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:51.922798 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a0684-8978-4e88-809e-50ae88a64134 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:51.923176 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a0684-8978-4e88-809e-50ae88a64134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:51.923548 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a0684-8978-4e88-809e-50ae88a64134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:51.933629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a0684-8978-4e88-809e-50ae88a64134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:51.935361 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a0684-8978-4e88-809e-50ae88a64134 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:51.946093 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 726/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:54.392865 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3baf31-21c6-42f7-9adb-1f2ca797bbe2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:54.393458 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3baf31-21c6-42f7-9adb-1f2ca797bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:54.393890 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3baf31-21c6-42f7-9adb-1f2ca797bbe2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:54.397180 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:54.403114 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bc23-1125-4214-a70e-cbab16755b27 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:54.403595 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bc23-1125-4214-a70e-cbab16755b27 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:54.403700 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bc23-1125-4214-a70e-cbab16755b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:54.422596 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3e27bc23-1125-4214-a70e-cbab16755b27 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:54.423806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3e27bc23-1125-4214-a70e-cbab16755b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:54.432497 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:54.472179 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3baf31-21c6-42f7-9adb-1f2ca797bbe2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:54.483930 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3baf31-21c6-42f7-9adb-1f2ca797bbe2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:54.487393 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472bb19-85e6-4e90-95a6-51b466d123b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:54.488028 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bb19-85e6-4e90-95a6-51b466d123b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:54.488302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bb19-85e6-4e90-95a6-51b466d123b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:54.488572 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bb19-85e6-4e90-95a6-51b466d123b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:54.498606 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472bb19-85e6-4e90-95a6-51b466d123b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:54.500278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472bb19-85e6-4e90-95a6-51b466d123b6 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:54.511850 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 734/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:56.912878 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6319-b837-425d-9573-d331cd309c9f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:56.913416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6319-b837-425d-9573-d331cd309c9f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:56.913416 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6319-b837-425d-9573-d331cd309c9f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:56.914804 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:56.920265 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4211-c67f-41a3-9675-a4b1904f6c29 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:56.920738 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4211-c67f-41a3-9675-a4b1904f6c29 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:56.921022 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4211-c67f-41a3-9675-a4b1904f6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:56.941563 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9e4e4211-c67f-41a3-9675-a4b1904f6c29 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:56.944208 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9e4e4211-c67f-41a3-9675-a4b1904f6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:56.954719 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:56.992812 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6319-b837-425d-9573-d331cd309c9f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:57.003512 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6319-b837-425d-9573-d331cd309c9f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:57.008145 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cae35-d9aa-4046-ac3a-687d43efdebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:57.008825 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cae35-d9aa-4046-ac3a-687d43efdebd service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:57.009108 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cae35-d9aa-4046-ac3a-687d43efdebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:57.009380 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cae35-d9aa-4046-ac3a-687d43efdebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:57.018738 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cae35-d9aa-4046-ac3a-687d43efdebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:57.020169 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cae35-d9aa-4046-ac3a-687d43efdebd service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:57.031029 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 729/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:06:59.356739 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85585-3dcc-490e-93b2-1426b8a2fffa None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:59.357332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85585-3dcc-490e-93b2-1426b8a2fffa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:59.357332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85585-3dcc-490e-93b2-1426b8a2fffa None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:59.358654 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:06:59.365057 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9509-c00b-474c-b623-46a84b91968c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:59.365591 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9509-c00b-474c-b623-46a84b91968c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:59.365825 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9509-c00b-474c-b623-46a84b91968c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:59.384734 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-de2d9509-c00b-474c-b623-46a84b91968c None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:06:59.386617 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-de2d9509-c00b-474c-b623-46a84b91968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:06:59.397595 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:06:59.446760 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a85585-3dcc-490e-93b2-1426b8a2fffa None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:06:59.458228 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a85585-3dcc-490e-93b2-1426b8a2fffa None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:06:59.462869 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0ff53-694d-4a6a-b161-ba5520de4417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:06:59.463515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ff53-694d-4a6a-b161-ba5520de4417 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:06:59.463800 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ff53-694d-4a6a-b161-ba5520de4417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:06:59.464109 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ff53-694d-4a6a-b161-ba5520de4417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:06:59.477940 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0ff53-694d-4a6a-b161-ba5520de4417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:06:59.480514 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0ff53-694d-4a6a-b161-ba5520de4417 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:06:59.493035 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 737/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:07:01.770590 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31517440-2c7a-490e-b945-cf3fc3071e48 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:01.771197 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31517440-2c7a-490e-b945-cf3fc3071e48 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:01.771197 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31517440-2c7a-490e-b945-cf3fc3071e48 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:01.772616 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 14:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:07:01.778811 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768d6b-6e3d-4af0-b5f6-42158e2d36e5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:01.779361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768d6b-6e3d-4af0-b5f6-42158e2d36e5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:01.779361 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768d6b-6e3d-4af0-b5f6-42158e2d36e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:01.799321 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-35768d6b-6e3d-4af0-b5f6-42158e2d36e5 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:01.800541 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-35768d6b-6e3d-4af0-b5f6-42158e2d36e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:01.809362 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 14:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:07:01.849248 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31517440-2c7a-490e-b945-cf3fc3071e48 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:07:01.860450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31517440-2c7a-490e-b945-cf3fc3071e48 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:07:01.865461 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e778b8c-cf15-4970-aa9d-b74a6395d054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:07:01.866141 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e778b8c-cf15-4970-aa9d-b74a6395d054 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:01.866426 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e778b8c-cf15-4970-aa9d-b74a6395d054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:01.866703 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e778b8c-cf15-4970-aa9d-b74a6395d054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:01.879691 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e778b8c-cf15-4970-aa9d-b74a6395d054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:07:01.881450 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e778b8c-cf15-4970-aa9d-b74a6395d054 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:07:01.893322 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 732/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:07:43.592310 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe2b8-d231-48c6-aaa2-801b6c0c3eb1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:43.593331 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe2b8-d231-48c6-aaa2-801b6c0c3eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:43.593426 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe2b8-d231-48c6-aaa2-801b6c0c3eb1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:43.594740 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 739/1471] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:07:43.599979 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f460cad-4667-4554-9ece-b250f69f40d0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:43.600459 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f460cad-4667-4554-9ece-b250f69f40d0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:43.600631 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f460cad-4667-4554-9ece-b250f69f40d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:43.618932 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9f460cad-4667-4554-9ece-b250f69f40d0 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:43.620155 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9f460cad-4667-4554-9ece-b250f69f40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:43.628842 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 733/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:07:43.676540 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959529-6d7e-42c4-8ab1-5d3db6ab5271 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:43.676856 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959529-6d7e-42c4-8ab1-5d3db6ab5271 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:43.677131 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959529-6d7e-42c4-8ab1-5d3db6ab5271 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:43.678466 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 740/1473] 10.222.0.13 () {54 vars in 962 bytes} [Mon May 16 14:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:07:43.683523 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51941f4f-801b-440b-9be3-548655bec034 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:43.683813 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51941f4f-801b-440b-9be3-548655bec034 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:43.684121 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51941f4f-801b-440b-9be3-548655bec034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:43.703279 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-51941f4f-801b-440b-9be3-548655bec034 None None] MFA Rules not processed for user `6c6aec0d7c7d4904a07bb4b812514701`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:43.704485 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-51941f4f-801b-440b-9be3-548655bec034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:43.710966 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 734/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Mon May 16 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:07:43.718901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959529-6d7e-42c4-8ab1-5d3db6ab5271 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:07:43.729502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959529-6d7e-42c4-8ab1-5d3db6ab5271 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:07:43.732958 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2495a0a-52a9-4cbb-8ffb-3231fbe52c57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c6aec0d7c7d4904a07bb4b812514701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:07:43.734288 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2495a0a-52a9-4cbb-8ffb-3231fbe52c57 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:43.734580 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2495a0a-52a9-4cbb-8ffb-3231fbe52c57 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:43.734840 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2495a0a-52a9-4cbb-8ffb-3231fbe52c57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:43.743707 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2495a0a-52a9-4cbb-8ffb-3231fbe52c57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:07:43.745161 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2495a0a-52a9-4cbb-8ffb-3231fbe52c57 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:07:43.755502 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 741/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:07:46.105823 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212e752-43c6-4d82-8ba5-bb9eed2a2249 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:46.106421 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212e752-43c6-4d82-8ba5-bb9eed2a2249 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:46.106421 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212e752-43c6-4d82-8ba5-bb9eed2a2249 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:46.107761 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 735/1476] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:07:46.113677 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44a18-8381-4334-a8dd-4f8e942cd913 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:46.114166 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44a18-8381-4334-a8dd-4f8e942cd913 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:46.114278 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44a18-8381-4334-a8dd-4f8e942cd913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:46.133400 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9ce44a18-8381-4334-a8dd-4f8e942cd913 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:46.134594 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9ce44a18-8381-4334-a8dd-4f8e942cd913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:46.142577 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 742/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:07:46.168160 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212e752-43c6-4d82-8ba5-bb9eed2a2249 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:07:46.181410 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212e752-43c6-4d82-8ba5-bb9eed2a2249 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:07:46.185677 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f184c-a427-4781-abd3-6f39dada8cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fec58596ab24b6da85e57a855ed085a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4548a84ff35448d493ae9458aa7d0261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:07:46.186808 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f184c-a427-4781-abd3-6f39dada8cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:46.187083 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f184c-a427-4781-abd3-6f39dada8cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:46.187347 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f184c-a427-4781-abd3-6f39dada8cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:46.188067 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f184c-a427-4781-abd3-6f39dada8cb1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:07:46.189844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: WARNING py.warnings [None req-b23f184c-a427-4781-abd3-6f39dada8cb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 14:07:46.189844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: warnings.warn(msg) May 16 14:07:46.189844 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: May 16 14:07:46.190970 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f184c-a427-4781-abd3-6f39dada8cb1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:07:46.211455 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 736/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 14:07:46 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:07:48.530967 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff523-d010-4764-bff1-18a3bc7ccc75 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:48.531557 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff523-d010-4764-bff1-18a3bc7ccc75 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:48.531557 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff523-d010-4764-bff1-18a3bc7ccc75 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:48.532901 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 743/1479] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:07:48.538291 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61686c-7c2c-4227-af3c-5cd7c2c90bd3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:48.538722 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61686c-7c2c-4227-af3c-5cd7c2c90bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:48.538838 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61686c-7c2c-4227-af3c-5cd7c2c90bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:48.557094 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2c61686c-7c2c-4227-af3c-5cd7c2c90bd3 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:48.558362 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2c61686c-7c2c-4227-af3c-5cd7c2c90bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:48.566192 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 737/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:07:48.609418 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ff523-d010-4764-bff1-18a3bc7ccc75 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:07:48.624028 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ff523-d010-4764-bff1-18a3bc7ccc75 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:07:48.629604 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2983d83-b505-432f-bdf4-c1fbe0abfb3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40d0702d56d47b48afc200b4de3027f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:07:48.630271 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2983d83-b505-432f-bdf4-c1fbe0abfb3a service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:48.630552 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2983d83-b505-432f-bdf4-c1fbe0abfb3a service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:48.630825 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2983d83-b505-432f-bdf4-c1fbe0abfb3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:48.639907 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2983d83-b505-432f-bdf4-c1fbe0abfb3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:07:48.641553 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2983d83-b505-432f-bdf4-c1fbe0abfb3a service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:07:48.651658 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 744/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:07:51.086626 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e7d9-0084-4a23-90f5-f180fe234324 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:51.087201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e7d9-0084-4a23-90f5-f180fe234324 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:51.087201 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e7d9-0084-4a23-90f5-f180fe234324 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:51.088525 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 738/1482] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:07:51.094855 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711025b3-2abe-47b1-8ab0-5b4bbbfbd219 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:51.095329 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711025b3-2abe-47b1-8ab0-5b4bbbfbd219 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:51.095481 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711025b3-2abe-47b1-8ab0-5b4bbbfbd219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:51.118344 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-711025b3-2abe-47b1-8ab0-5b4bbbfbd219 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:51.119462 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-711025b3-2abe-47b1-8ab0-5b4bbbfbd219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:51.127980 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 745/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:07:51.165095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6e7d9-0084-4a23-90f5-f180fe234324 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:07:51.179098 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6e7d9-0084-4a23-90f5-f180fe234324 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:07:51.184429 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292df6be-5f07-4720-98aa-d2e4dd24fad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:07:51.185448 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292df6be-5f07-4720-98aa-d2e4dd24fad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:51.185892 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292df6be-5f07-4720-98aa-d2e4dd24fad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:51.186335 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292df6be-5f07-4720-98aa-d2e4dd24fad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:51.201047 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292df6be-5f07-4720-98aa-d2e4dd24fad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:07:51.204040 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292df6be-5f07-4720-98aa-d2e4dd24fad2 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:07:51.215629 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 739/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:07:53.578668 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd900-10e7-4e56-a66e-4c0a9e3c5c86 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:53.579269 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd900-10e7-4e56-a66e-4c0a9e3c5c86 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:53.579269 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd900-10e7-4e56-a66e-4c0a9e3c5c86 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:53.580566 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 746/1485] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:07:53.586015 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a263-9f2f-4403-811e-90b0d0a5a7cb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:53.586473 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a263-9f2f-4403-811e-90b0d0a5a7cb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:53.586594 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a263-9f2f-4403-811e-90b0d0a5a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:53.605708 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b1a4a263-9f2f-4403-811e-90b0d0a5a7cb None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:53.606935 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b1a4a263-9f2f-4403-811e-90b0d0a5a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:53.615355 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 740/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 14:07:53.653575 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd900-10e7-4e56-a66e-4c0a9e3c5c86 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:07:53.665300 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd900-10e7-4e56-a66e-4c0a9e3c5c86 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:07:53.668868 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f05826-bfc0-4022-a9ae-6164783b3c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:07:53.669507 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05826-bfc0-4022-a9ae-6164783b3c31 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:53.669814 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05826-bfc0-4022-a9ae-6164783b3c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:53.671160 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05826-bfc0-4022-a9ae-6164783b3c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:53.681030 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05826-bfc0-4022-a9ae-6164783b3c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:07:53.682515 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05826-bfc0-4022-a9ae-6164783b3c31 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:07:53.692332 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 747/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:07:56.051787 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b186-5440-4543-b9f8-71b64e89c367 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:56.052360 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b186-5440-4543-b9f8-71b64e89c367 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:56.052360 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b186-5440-4543-b9f8-71b64e89c367 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:56.053728 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 741/1488] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:07:56.059024 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddef04-964a-4d3c-b99a-dfb231b6b1e6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:56.059444 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddef04-964a-4d3c-b99a-dfb231b6b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:56.059565 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddef04-964a-4d3c-b99a-dfb231b6b1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:56.078095 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c2ddef04-964a-4d3c-b99a-dfb231b6b1e6 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:56.079302 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c2ddef04-964a-4d3c-b99a-dfb231b6b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:56.087133 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 748/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:07:56.128985 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174b186-5440-4543-b9f8-71b64e89c367 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:07:56.139806 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174b186-5440-4543-b9f8-71b64e89c367 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:07:56.143268 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a5a8a-7d9b-43fb-bf5a-fe43c538a484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:07:56.143900 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a5a8a-7d9b-43fb-bf5a-fe43c538a484 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:56.144177 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a5a8a-7d9b-43fb-bf5a-fe43c538a484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:56.144452 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a5a8a-7d9b-43fb-bf5a-fe43c538a484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:56.153309 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a5a8a-7d9b-43fb-bf5a-fe43c538a484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:07:56.155267 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a5a8a-7d9b-43fb-bf5a-fe43c538a484 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:07:56.164645 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 742/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 14:07:58.710314 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba329-2a11-4fde-9b89-4130655be74a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:58.710891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba329-2a11-4fde-9b89-4130655be74a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:58.710891 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba329-2a11-4fde-9b89-4130655be74a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:58.712224 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 749/1491] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 14:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:07:58.718352 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289aec8-57e6-4d9d-bab4-e4f90df70e93 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:58.718821 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289aec8-57e6-4d9d-bab4-e4f90df70e93 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:58.718927 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289aec8-57e6-4d9d-bab4-e4f90df70e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:58.866095 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4289aec8-57e6-4d9d-bab4-e4f90df70e93 None None] MFA Rules not processed for user `1fec58596ab24b6da85e57a855ed085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:07:58.867313 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4289aec8-57e6-4d9d-bab4-e4f90df70e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:07:58.876427 dv-cinder-795785-9-iscsi devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 743/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 14:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 14:07:58.916477 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ba329-2a11-4fde-9b89-4130655be74a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:07:58.927492 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ba329-2a11-4fde-9b89-4130655be74a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:07:58.931045 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6f984-d1dc-4497-b3b5-49936260e667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c352582d4014e008ff92350808c84f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '234bca5b36fd483b9b37f1883b5028ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:07:58.931676 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6f984-d1dc-4497-b3b5-49936260e667 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:07:58.931955 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6f984-d1dc-4497-b3b5-49936260e667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:07:58.932226 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6f984-d1dc-4497-b3b5-49936260e667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:07:58.942261 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6f984-d1dc-4497-b3b5-49936260e667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:07:58.943693 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6f984-d1dc-4497-b3b5-49936260e667 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:07:58.954062 dv-cinder-795785-9-iscsi devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 750/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 14:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)